Oct 20 11:28:41 user nova-compute[74241]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74241) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74241) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74241) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 11:28:41 user nova-compute[74241]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:28:41 user nova-compute[74241]: INFO nova.virt.driver [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 20 11:28:41 user nova-compute[74241]: INFO nova.compute.provider_config [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] Acquiring lock "singleton_lock" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] Acquired lock "singleton_lock" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] Releasing lock "singleton_lock" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] Full set of CONF: {{(pid=74241) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ******************************************************************************** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] Configuration options gathered from: {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ================================================================================ {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] allow_resize_to_same_host      = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] arq_binding_timeout            = 300 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] backdoor_port                  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] backdoor_socket                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] block_device_allocate_retries  = 300 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] block_device_allocate_retries_interval = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cert                           = self.pem {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute_monitors               = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] config_dir                     = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] config_drive_format            = iso9660 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] config_source                  = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] console_host                   = user {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] control_exchange               = nova {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cpu_allocation_ratio           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] daemon                         = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] debug                          = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] default_access_ip_network_name = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] default_availability_zone      = nova {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] default_ephemeral_format       = ext4 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] default_green_pool_size        = 1000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] default_schedule_zone          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] disk_allocation_ratio          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] enable_new_services            = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] enabled_ssl_apis               = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] flat_injected                  = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] force_config_drive             = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] force_raw_images               = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] graceful_shutdown_timeout      = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] heal_instance_info_cache_interval = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] host                           = user {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] instance_build_timeout         = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] instance_delete_interval       = 300 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] instance_name_template         = instance-%08x {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] instance_usage_audit           = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] instance_usage_audit_period    = month {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] internal_service_availability_zone = internal {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] key                            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] live_migration_retry_count     = 30 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] log_config_append              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] log_dir                        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] log_file                       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] log_options                    = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] log_rotate_interval            = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] log_rotate_interval_type       = days {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] log_rotation_type              = none {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] long_rpc_timeout               = 1800 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] max_concurrent_builds          = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] max_concurrent_live_migrations = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] max_concurrent_snapshots       = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] max_local_block_devices        = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] max_logfile_count              = 30 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] max_logfile_size_mb            = 200 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] maximum_instance_delete_attempts = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] metadata_listen                = 0.0.0.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] metadata_listen_port           = 8775 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] metadata_workers               = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] migrate_max_retries            = -1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] mkisofs_cmd                    = genisoimage {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] my_ip                          = 10.0.0.210 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] network_allocate_retries       = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] osapi_compute_listen_port      = 8774 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] osapi_compute_unique_server_name_scope =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] osapi_compute_workers          = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] password_length                = 12 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] periodic_enable                = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] periodic_fuzzy_delay           = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] pointer_model                  = ps2mouse {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] preallocate_images             = none {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] publish_errors                 = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] pybasedir                      = /opt/stack/nova {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ram_allocation_ratio           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] rate_limit_burst               = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] rate_limit_except_level        = CRITICAL {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] rate_limit_interval            = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] reboot_timeout                 = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] reclaim_instance_interval      = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] record                         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] reimage_timeout_per_gb         = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] report_interval                = 120 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] rescue_timeout                 = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] reserved_host_cpus             = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] reserved_host_disk_mb          = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] reserved_host_memory_mb        = 512 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] reserved_huge_pages            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] resize_confirm_window          = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] resize_fs_using_block_device   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] resume_guests_state_on_host_boot = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] rpc_response_timeout           = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] run_external_periodic_tasks    = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] running_deleted_instance_action = reap {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] running_deleted_instance_timeout = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler_instance_sync_interval = 120 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_down_time              = 720 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] servicegroup_driver            = db {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] shelved_offload_time           = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] shelved_poll_interval          = 3600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] shutdown_timeout               = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] source_is_ipv6                 = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ssl_only                       = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] state_path                     = /opt/stack/data/nova {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] sync_power_state_interval      = 600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] sync_power_state_pool_size     = 1000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] syslog_log_facility            = LOG_USER {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] tempdir                        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] timeout_nbd                    = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:41 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] transport_url                  = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] update_resources_interval      = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] use_cow_images                 = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] use_eventlog                   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] use_journal                    = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] use_json                       = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] use_rootwrap_daemon            = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] use_stderr                     = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] use_syslog                     = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vcpu_pin_set                   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plugging_is_fatal          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plugging_timeout           = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] virt_mkfs                      = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] volume_usage_poll_interval     = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] watch_log_file                 = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] web                            = /usr/share/spice-html5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_concurrency.disable_process_locking = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.auth_strategy              = keystone {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.compute_link_prefix        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.dhcp_domain                = novalocal {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.enable_instance_password   = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.glance_link_prefix         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.instance_list_per_project_cells = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.list_records_by_skipping_down_cells = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.local_metadata_per_cell    = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.max_limit                  = 1000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.metadata_cache_expiration  = 15 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.neutron_default_tenant_id  = default {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.use_forwarded_for          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.use_neutron_default_nets   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.vendordata_dynamic_targets = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.vendordata_jsonfile_path   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.backend_argument         = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.config_prefix            = cache.oslo {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.dead_timeout             = 60.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.debug_cache_backend      = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.enable_retry_client      = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.enable_socket_keepalive  = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.enabled                  = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.expiration_time          = 600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.hashclient_retry_attempts = 2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_dead_retry      = 300 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_password        =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_sasl_enabled    = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.memcache_username        =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.proxies                  = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.retry_attempts           = 2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.retry_delay              = 0.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.socket_keepalive_count   = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.socket_keepalive_idle    = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.socket_keepalive_interval = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.tls_allowed_ciphers      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.tls_cafile               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.tls_certfile             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.tls_enabled              = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cache.tls_keyfile              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.auth_section            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.auth_type               = password {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.cafile                  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.certfile                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.collect_timing          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.cross_az_attach         = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.debug                   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.endpoint_template       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.http_retries            = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.insecure                = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.keyfile                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.os_region_name          = RegionOne {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.split_loggers           = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cinder.timeout                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.cpu_dedicated_set      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.cpu_shared_set         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.image_type_exclude_list = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.resource_provider_association_refresh = 300 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.shutdown_retry_interval = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] conductor.workers              = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] console.allowed_origins        = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] console.ssl_ciphers            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] console.ssl_minimum_version    = default {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] consoleauth.token_ttl          = 600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.cafile                  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.certfile                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.collect_timing          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.connect_retries         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.connect_retry_delay     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.endpoint_override       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.insecure                = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.keyfile                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.max_version             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.min_version             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.region_name             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.service_name            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.service_type            = accelerator {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.split_loggers           = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.status_code_retries     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.status_code_retry_delay = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.timeout                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] cyborg.version                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.backend               = sqlalchemy {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.connection            = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.connection_debug      = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.connection_parameters =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.connection_recycle_time = 3600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.connection_trace      = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.db_inc_retry_interval = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.db_max_retries        = 20 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.db_max_retry_interval = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.db_retry_interval     = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.max_overflow          = 50 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.max_pool_size         = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.max_retries           = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.mysql_wsrep_sync_wait = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.pool_timeout          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.retry_interval        = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.slave_connection      = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] database.sqlite_synchronous    = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.backend           = sqlalchemy {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.connection        = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.connection_debug  = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.connection_parameters =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.connection_recycle_time = 3600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.connection_trace  = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.db_inc_retry_interval = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.db_max_retries    = 20 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.db_max_retry_interval = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.db_retry_interval = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.max_overflow      = 50 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.max_pool_size     = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.max_retries       = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.pool_timeout      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.retry_interval    = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.slave_connection  = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] api_database.sqlite_synchronous = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] devices.enabled_mdev_types     = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ephemeral_storage_encryption.enabled = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.api_servers             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.cafile                  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.certfile                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.collect_timing          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.connect_retries         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.connect_retry_delay     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.debug                   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.default_trusted_certificate_ids = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.enable_certificate_validation = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.enable_rbd_download     = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.endpoint_override       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.insecure                = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.keyfile                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.max_version             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.min_version             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.num_retries             = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.rbd_ceph_conf           =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.rbd_connect_timeout     = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.rbd_pool                =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.rbd_user                =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.region_name             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.service_name            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.service_type            = image {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.split_loggers           = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.status_code_retries     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.status_code_retry_delay = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.timeout                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.verify_glance_signatures = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] glance.version                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] guestfs.debug                  = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.config_drive_cdrom      = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.config_drive_inject_password = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.enable_remotefx         = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.instances_path_share    =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.limit_cpu_features      = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.use_multipath_io        = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.vswitch_name            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] mks.enabled                    = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] image_cache.manager_interval   = 2400 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] image_cache.precache_concurrency = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] image_cache.remove_unused_base_images = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] image_cache.subdirectory_name  = _base {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.api_max_retries         = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.api_retry_interval      = 2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.auth_section            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.auth_type               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.cafile                  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.certfile                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.collect_timing          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.conductor_group         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.connect_retries         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.connect_retry_delay     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.endpoint_override       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.insecure                = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.keyfile                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.max_version             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.min_version             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.peer_list               = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.region_name             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.serial_console_state_timeout = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.service_name            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.service_type            = baremetal {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.split_loggers           = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.status_code_retries     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.status_code_retry_delay = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.timeout                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ironic.version                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] key_manager.fixed_key          = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.barbican_api_version  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.barbican_endpoint     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.barbican_endpoint_type = public {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.barbican_region_name  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.cafile                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.certfile              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.collect_timing        = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.insecure              = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.keyfile               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.number_of_retries     = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.retry_delay           = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.send_service_user_token = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.split_loggers         = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.timeout               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.verify_ssl            = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican.verify_ssl_path       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.auth_section = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.auth_type = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.cafile   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.certfile = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.collect_timing = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.insecure = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.keyfile  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.split_loggers = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] barbican_service_user.timeout  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.approle_role_id          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.approle_secret_id        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.cafile                   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.certfile                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.collect_timing           = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.insecure                 = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.keyfile                  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.kv_mountpoint            = secret {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.kv_path                  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.kv_version               = 2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.namespace                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.root_token_id            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.split_loggers            = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.ssl_ca_crt_file          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.timeout                  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.use_ssl                  = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.auth_section          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.auth_type             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.cafile                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.certfile              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.collect_timing        = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.connect_retries       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.connect_retry_delay   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.endpoint_override     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.insecure              = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.keyfile               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.max_version           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.min_version           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.region_name           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.service_name          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.service_type          = identity {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.split_loggers         = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.status_code_retries   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.status_code_retry_delay = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.timeout               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] keystone.version               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.connection_uri         =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.cpu_mode               = custom {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: WARNING oslo_config.cfg [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.cpu_power_governor_high = performance {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.cpu_power_management   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.device_detach_attempts = 8 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.device_detach_timeout  = 20 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.disk_cachemodes        = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.disk_prefix            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.enabled_perf_events    = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.file_backed_memory     = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.gid_maps               = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.hw_disk_discard        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.hw_machine_type        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.images_rbd_pool        = rbd {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.images_type            = default {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.images_volume_group    = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.inject_key             = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.inject_partition       = -2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.inject_password        = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.iscsi_iface            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.iser_use_multipath     = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_downtime = 500 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_inbound_addr = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_scheme  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_timeout_action = abort {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_tunnelled = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: WARNING oslo_config.cfg [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 20 11:28:42 user nova-compute[74241]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 20 11:28:42 user nova-compute[74241]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 20 11:28:42 user nova-compute[74241]: and ``live_migration_inbound_addr`` respectively.
Oct 20 11:28:42 user nova-compute[74241]: ).  Its value may be silently ignored in the future.
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.live_migration_with_native_tls = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.max_queues             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.nfs_mount_options      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.num_pcie_ports         = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.pmem_namespaces        = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.quobyte_client_cfg     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rbd_secret_uuid        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rbd_user               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rescue_image_id        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rescue_kernel_id       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.rx_queue_size          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.smbfs_mount_options    =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.snapshot_compression   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.snapshot_image_format  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.sparse_logical_volumes = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.swtpm_enabled          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.swtpm_group            = tss {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.swtpm_user             = tss {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.sysinfo_serial         = unique {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.tb_cache_size          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.tx_queue_size          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.uid_maps               = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.use_virtio_for_bridges = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.virt_type              = kvm {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.volume_clear           = zero {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.volume_clear_size      = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.volume_use_multipath   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.vzstorage_cache_path   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.auth_section           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.auth_type              = password {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.cafile                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.certfile               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.collect_timing         = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.connect_retries        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.connect_retry_delay    = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.default_floating_pool  = public {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.endpoint_override      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.extension_sync_interval = 600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.http_retries           = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.insecure               = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.keyfile                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.max_version            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.min_version            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.ovs_bridge             = br-int {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.physnets               = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.region_name            = RegionOne {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.service_metadata_proxy = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.service_name           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.service_type           = network {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.split_loggers          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.status_code_retries    = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.status_code_retry_delay = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.timeout                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] neutron.version                = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] notifications.bdms_in_notifications = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] notifications.default_level    = INFO {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] notifications.notification_format = unversioned {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] notifications.notify_on_state_change = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] pci.alias                      = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] pci.device_spec                = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] pci.report_in_placement        = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.auth_section         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.auth_type            = password {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.cafile               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.certfile             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.collect_timing       = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.connect_retries      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.connect_retry_delay  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.default_domain_id    = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.default_domain_name  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.domain_id            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.domain_name          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.endpoint_override    = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.insecure             = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.keyfile              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.max_version          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.min_version          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.password             = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.project_domain_id    = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.project_domain_name  = Default {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.project_id           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.project_name         = service {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.region_name          = RegionOne {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.service_name         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.service_type         = placement {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.split_loggers        = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.status_code_retries  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.status_code_retry_delay = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.system_scope         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.timeout              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.trust_id             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.user_domain_id       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.user_domain_name     = Default {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.user_id              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.username             = placement {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] placement.version              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.cores                    = 20 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.count_usage_from_placement = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.injected_file_content_bytes = 10240 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.injected_file_path_length = 255 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.injected_files           = 5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.instances                = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.key_pairs                = 100 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.metadata_items           = 128 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.ram                      = 51200 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.recheck_quota            = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.server_group_members     = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] quota.server_groups            = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] rdp.enabled                    = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.image_metadata_prefilter = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.max_attempts         = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.max_placement_results = 1000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] scheduler.workers              = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.host_subset_size = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.isolated_hosts = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.isolated_images = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.pci_in_placement = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.track_instance_changes = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] metrics.required               = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] metrics.weight_multiplier      = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] metrics.weight_setting         = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] serial_console.enabled         = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] serial_console.port_range      = 10000:20000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] serial_console.serialproxy_port = 6083 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.auth_section      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.auth_type         = password {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.cafile            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.certfile          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.collect_timing    = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.insecure          = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.keyfile           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.send_service_user_token = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.split_loggers     = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] service_user.timeout           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.agent_enabled            = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.enabled                  = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.html5proxy_port          = 6082 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.image_compression        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.jpeg_compression         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.playback_compression     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.server_listen            = 127.0.0.1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.streaming_mode           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] spice.zlib_compression         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] upgrade_levels.baseapi         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] upgrade_levels.cert            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] upgrade_levels.compute         = auto {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] upgrade_levels.conductor       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] upgrade_levels.scheduler       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.cafile = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.certfile = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.insecure = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vendordata_dynamic_auth.timeout = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.api_retry_count         = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.ca_file                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.cache_prefix            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.cluster_name            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.connection_pool_size    = 10 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.console_delay_seconds   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.datastore_regex         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.host_ip                 = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.host_password           = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.host_port               = 443 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.host_username           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.insecure                = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.integration_bridge      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.maximum_objects         = 100 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.pbm_default_policy      = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.pbm_enabled             = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.pbm_wsdl_location       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.serial_port_proxy_uri   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.serial_port_service_uri = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.task_poll_interval      = 0.5 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.use_linked_clone        = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.vnc_keymap              = en-us {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.vnc_port                = 5900 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vmware.vnc_port_total          = 10000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.auth_schemes               = ['none'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.enabled                    = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.novncproxy_port            = 6080 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.vencrypt_ca_certs          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.vencrypt_client_cert       = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vnc.vencrypt_client_key        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.disable_rootwrap   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.enable_numa_live_migration = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.libvirt_disable_apic = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.client_socket_timeout     = 900 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.default_pool_size         = 1000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.keep_alive                = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.max_header_line           = 16384 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.ssl_ca_file               = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.ssl_cert_file             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.ssl_key_file              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.tcp_keepidle              = 600 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] zvm.ca_file                    = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] zvm.cloud_connector_url        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] zvm.reachable_timeout          = 300 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.enforce_new_defaults = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.enforce_scope      = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.policy_default_rule = default {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.connection_string     = messaging:// {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.enabled               = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.es_doc_type           = notification {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.es_scroll_size        = 10000 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.es_scroll_time        = 2m {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.filter_error_trace    = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.hmac_keys             = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.sentinel_service_name = mymaster {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.socket_timeout        = 0.1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.trace_requests        = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler.trace_sqlalchemy      = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler_jaeger.process_tags   = {} {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler_jaeger.service_name_prefix = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] profiler_otlp.service_name_prefix = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] remote_debug.host              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] remote_debug.port              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_notifications.retry = -1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.auth_section        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.auth_type           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.cafile              = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.certfile            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.collect_timing      = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.connect_retries     = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.connect_retry_delay = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.endpoint_id         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.endpoint_override   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.insecure            = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.keyfile             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.max_version         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.min_version         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.region_name         = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.service_name        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.service_type        = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.split_loggers       = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.status_code_retries = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.status_code_retry_delay = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.timeout             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.valid_interfaces    = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_limit.version             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_reports.file_event_handler = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] oslo_reports.log_dir           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_ovs_privileged.group  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] vif_plug_ovs_privileged.user   = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_ovs.isolate_vif         = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] os_brick.lock_path             = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] privsep_osbrick.capabilities   = [21] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] privsep_osbrick.group          = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] privsep_osbrick.helper_command = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] privsep_osbrick.user           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] nova_sys_admin.group           = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] nova_sys_admin.helper_command  = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] nova_sys_admin.user            = None {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG oslo_service.service [None req-fa460b01-be38-41a1-8ac9-26d9cf1410e6 None None] ******************************************************************************** {{(pid=74241) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 20 11:28:42 user nova-compute[74241]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 20 11:28:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Connecting to libvirt: qemu:///system {{(pid=74241) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f5248a22470> {{(pid=74241) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 20 11:28:42 user nova-compute[74241]: libvirt:  error : internal error: could not initialize domain event timer
Oct 20 11:28:42 user nova-compute[74241]: WARNING nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 20 11:28:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f5248a22470> {{(pid=74241) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Starting native event thread {{(pid=74241) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Starting green dispatch thread {{(pid=74241) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 20 11:28:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Starting connection event dispatch thread {{(pid=74241) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 20 11:28:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Connection event '1' reason 'None'
Oct 20 11:28:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 11:28:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.mount [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Initialising _HostMountState generation 0 {{(pid=74241) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 20 11:28:49 user nova-compute[74241]: INFO nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host capabilities <capabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <host>
Oct 20 11:28:49 user nova-compute[74241]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 20 11:28:49 user nova-compute[74241]:     <cpu>
Oct 20 11:28:49 user nova-compute[74241]:       <arch>x86_64</arch>
Oct 20 11:28:49 user nova-compute[74241]:       <model>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <microcode version='1070'/>
Oct 20 11:28:49 user nova-compute[74241]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 20 11:28:49 user nova-compute[74241]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='osxsave'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='invtsc'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='rsba'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature name='skip-l1dfl-vmentry'/>
Oct 20 11:28:49 user nova-compute[74241]:       <pages unit='KiB' size='4'/>
Oct 20 11:28:49 user nova-compute[74241]:       <pages unit='KiB' size='2048'/>
Oct 20 11:28:49 user nova-compute[74241]:     </cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <power_management>
Oct 20 11:28:49 user nova-compute[74241]:       <suspend_mem/>
Oct 20 11:28:49 user nova-compute[74241]:       <suspend_disk/>
Oct 20 11:28:49 user nova-compute[74241]:       <suspend_hybrid/>
Oct 20 11:28:49 user nova-compute[74241]:     </power_management>
Oct 20 11:28:49 user nova-compute[74241]:     <iommu support='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <migration_features>
Oct 20 11:28:49 user nova-compute[74241]:       <live/>
Oct 20 11:28:49 user nova-compute[74241]:       <uri_transports>
Oct 20 11:28:49 user nova-compute[74241]:         <uri_transport>tcp</uri_transport>
Oct 20 11:28:49 user nova-compute[74241]:         <uri_transport>rdma</uri_transport>
Oct 20 11:28:49 user nova-compute[74241]:       </uri_transports>
Oct 20 11:28:49 user nova-compute[74241]:     </migration_features>
Oct 20 11:28:49 user nova-compute[74241]:     <topology>
Oct 20 11:28:49 user nova-compute[74241]:       <cells num='2'>
Oct 20 11:28:49 user nova-compute[74241]:         <cell id='0'>
Oct 20 11:28:49 user nova-compute[74241]:           <memory unit='KiB'>8189224</memory>
Oct 20 11:28:49 user nova-compute[74241]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 20 11:28:49 user nova-compute[74241]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 11:28:49 user nova-compute[74241]:           <distances>
Oct 20 11:28:49 user nova-compute[74241]:             <sibling id='0' value='10'/>
Oct 20 11:28:49 user nova-compute[74241]:             <sibling id='1' value='20'/>
Oct 20 11:28:49 user nova-compute[74241]:           </distances>
Oct 20 11:28:49 user nova-compute[74241]:           <cpus num='6'>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 20 11:28:49 user nova-compute[74241]:           </cpus>
Oct 20 11:28:49 user nova-compute[74241]:         </cell>
Oct 20 11:28:49 user nova-compute[74241]:         <cell id='1'>
Oct 20 11:28:49 user nova-compute[74241]:           <memory unit='KiB'>8206460</memory>
Oct 20 11:28:49 user nova-compute[74241]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 20 11:28:49 user nova-compute[74241]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 11:28:49 user nova-compute[74241]:           <distances>
Oct 20 11:28:49 user nova-compute[74241]:             <sibling id='0' value='20'/>
Oct 20 11:28:49 user nova-compute[74241]:             <sibling id='1' value='10'/>
Oct 20 11:28:49 user nova-compute[74241]:           </distances>
Oct 20 11:28:49 user nova-compute[74241]:           <cpus num='6'>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 20 11:28:49 user nova-compute[74241]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 20 11:28:49 user nova-compute[74241]:           </cpus>
Oct 20 11:28:49 user nova-compute[74241]:         </cell>
Oct 20 11:28:49 user nova-compute[74241]:       </cells>
Oct 20 11:28:49 user nova-compute[74241]:     </topology>
Oct 20 11:28:49 user nova-compute[74241]:     <cache>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 20 11:28:49 user nova-compute[74241]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 20 11:28:49 user nova-compute[74241]:     </cache>
Oct 20 11:28:49 user nova-compute[74241]:     <secmodel>
Oct 20 11:28:49 user nova-compute[74241]:       <model>apparmor</model>
Oct 20 11:28:49 user nova-compute[74241]:       <doi>0</doi>
Oct 20 11:28:49 user nova-compute[74241]:     </secmodel>
Oct 20 11:28:49 user nova-compute[74241]:     <secmodel>
Oct 20 11:28:49 user nova-compute[74241]:       <model>dac</model>
Oct 20 11:28:49 user nova-compute[74241]:       <doi>0</doi>
Oct 20 11:28:49 user nova-compute[74241]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 20 11:28:49 user nova-compute[74241]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 20 11:28:49 user nova-compute[74241]:     </secmodel>
Oct 20 11:28:49 user nova-compute[74241]:   </host>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='alpha'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>clipper</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='armv6l'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>spitz</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>nuri</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>kzm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sx1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>z2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>tosa</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>n810</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>n800</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>terrier</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>midway</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>microbit</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>verdex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>highbank</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>akita</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>connex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>collie</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='armv7l'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>spitz</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>nuri</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>kzm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sx1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>z2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>tosa</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>n810</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>n800</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>terrier</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>midway</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>microbit</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>verdex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>highbank</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>akita</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>connex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>collie</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='aarch64'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>spitz</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>nuri</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>kzm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sx1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>z2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>tosa</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>n810</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>n800</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>terrier</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>midway</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>microbit</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>verdex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>raspi3b</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>highbank</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>akita</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>connex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>collie</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <acpi default='on' toggle='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='cris'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='i686'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>isapc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>microvm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='kvm'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <pae/>
Oct 20 11:28:49 user nova-compute[74241]:       <nonpae/>
Oct 20 11:28:49 user nova-compute[74241]:       <acpi default='on' toggle='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:       <apic default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='m68k'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>an5206</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>q800</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>next-cube</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='microblaze'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='microblazeel'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='mips'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='16'>malta</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='mipsel'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='16'>malta</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='mips64'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='16'>malta</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>pica61</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>magnum</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='mips64el'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='16'>malta</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>pica61</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>magnum</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='16'>boston</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='ppc'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mac99</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>40p</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>taihu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='ppc64'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>taihu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>40p</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mac99</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='ppc64le'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>taihu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>40p</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>mac99</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='riscv32'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='8'>spike</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>opentitan</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='8'>virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='riscv64'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='8'>spike</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>shakti_c</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='8'>virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='s390x'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='sh4'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>shix</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>r2d</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='sh4eb'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>shix</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>r2d</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='sparc'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>SS-5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>SS-20</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>LX</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>SS-4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>SS-10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>Voyager</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='sparc64'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sun4u</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>niagara</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>sun4v</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='x86_64'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>64</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='1'>isapc</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>microvm</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='kvm'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <acpi default='on' toggle='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:       <apic default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='xtensa'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>sim</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>kc705</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>ml605</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>lx200</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>lx60</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]:   <guest>
Oct 20 11:28:49 user nova-compute[74241]:     <os_type>hvm</os_type>
Oct 20 11:28:49 user nova-compute[74241]:     <arch name='xtensaeb'>
Oct 20 11:28:49 user nova-compute[74241]:       <wordsize>32</wordsize>
Oct 20 11:28:49 user nova-compute[74241]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='4'>sim</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>kc705</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>ml605</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>virt</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>lx200</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>lx60</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 11:28:49 user nova-compute[74241]:       <domain type='qemu'/>
Oct 20 11:28:49 user nova-compute[74241]:     </arch>
Oct 20 11:28:49 user nova-compute[74241]:     <features>
Oct 20 11:28:49 user nova-compute[74241]:       <cpuselection/>
Oct 20 11:28:49 user nova-compute[74241]:       <deviceboot/>
Oct 20 11:28:49 user nova-compute[74241]:       <disksnapshot default='on' toggle='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     </features>
Oct 20 11:28:49 user nova-compute[74241]:   </guest>
Oct 20 11:28:49 user nova-compute[74241]: </capabilities>
Oct 20 11:28:49 user nova-compute[74241]: 
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 20 11:28:49 user nova-compute[74241]: <domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 11:28:49 user nova-compute[74241]:   <domain>kvm</domain>
Oct 20 11:28:49 user nova-compute[74241]:   <machine>pc-q35-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:   <arch>i686</arch>
Oct 20 11:28:49 user nova-compute[74241]:   <vcpu max='288'/>
Oct 20 11:28:49 user nova-compute[74241]:   <iothreads supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:   <os supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='firmware'/>
Oct 20 11:28:49 user nova-compute[74241]:     <loader supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>rom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pflash</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='readonly'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='secure'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </loader>
Oct 20 11:28:49 user nova-compute[74241]:   </os>
Oct 20 11:28:49 user nova-compute[74241]:   <cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-passthrough' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='hostPassthroughMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='maximum' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='maximumMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-model' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='umip'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibpb'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibrs'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='erms'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='lm'/>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='custom' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>qemu64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>qemu32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>phenom</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>n270</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>kvm64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>coreduo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>core2duo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>athlon</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Westmere</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Snowridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Penryn</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G5</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G4</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G1</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Rome</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Milan</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Dhyana</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cooperlake</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Conroe</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>486</model>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:   </cpu>
Oct 20 11:28:49 user nova-compute[74241]:   <memoryBacking supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='sourceType'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>file</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>anonymous</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>memfd</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:   </memoryBacking>
Oct 20 11:28:49 user nova-compute[74241]:   <devices>
Oct 20 11:28:49 user nova-compute[74241]:     <disk supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='diskDevice'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>disk</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cdrom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>floppy</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>lun</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='bus'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>fdc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sata</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </disk>
Oct 20 11:28:49 user nova-compute[74241]:     <graphics supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sdl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vnc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>spice</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egl-headless</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </graphics>
Oct 20 11:28:49 user nova-compute[74241]:     <video supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='modelType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cirrus</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vmvga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>qxl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>none</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>bochs</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ramfb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </video>
Oct 20 11:28:49 user nova-compute[74241]:     <hostdev supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='mode'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>subsystem</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='startupPolicy'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>default</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>mandatory</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>requisite</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>optional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='subsysType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pci</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='capsType'/>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='pciBackend'/>
Oct 20 11:28:49 user nova-compute[74241]:     </hostdev>
Oct 20 11:28:49 user nova-compute[74241]:     <rng supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>random</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egd</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>builtin</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </rng>
Oct 20 11:28:49 user nova-compute[74241]:     <filesystem supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='driverType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>path</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>handle</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtiofs</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </filesystem>
Oct 20 11:28:49 user nova-compute[74241]:     <tpm supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-tis</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-crb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>passthrough</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>emulator</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </tpm>
Oct 20 11:28:49 user nova-compute[74241]:   </devices>
Oct 20 11:28:49 user nova-compute[74241]:   <features>
Oct 20 11:28:49 user nova-compute[74241]:     <gic supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <vmcoreinfo supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <genid supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backingStoreInput supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backup supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <sev supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:   </features>
Oct 20 11:28:49 user nova-compute[74241]: </domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 20 11:28:49 user nova-compute[74241]: <domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 11:28:49 user nova-compute[74241]:   <domain>kvm</domain>
Oct 20 11:28:49 user nova-compute[74241]:   <machine>pc-q35-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:   <arch>i686</arch>
Oct 20 11:28:49 user nova-compute[74241]:   <vcpu max='288'/>
Oct 20 11:28:49 user nova-compute[74241]:   <iothreads supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:   <os supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='firmware'/>
Oct 20 11:28:49 user nova-compute[74241]:     <loader supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>rom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pflash</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='readonly'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='secure'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </loader>
Oct 20 11:28:49 user nova-compute[74241]:   </os>
Oct 20 11:28:49 user nova-compute[74241]:   <cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-passthrough' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='hostPassthroughMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='maximum' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='maximumMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-model' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='umip'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibpb'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibrs'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='erms'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='lm'/>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='custom' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>qemu64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>qemu32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>phenom</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>n270</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>kvm64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>coreduo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>core2duo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>athlon</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Westmere</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Snowridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Penryn</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G5</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G4</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G1</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Rome</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Milan</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Dhyana</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cooperlake</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Conroe</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>486</model>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:   </cpu>
Oct 20 11:28:49 user nova-compute[74241]:   <memoryBacking supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='sourceType'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>file</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>anonymous</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>memfd</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:   </memoryBacking>
Oct 20 11:28:49 user nova-compute[74241]:   <devices>
Oct 20 11:28:49 user nova-compute[74241]:     <disk supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='diskDevice'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>disk</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cdrom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>floppy</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>lun</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='bus'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>fdc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sata</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </disk>
Oct 20 11:28:49 user nova-compute[74241]:     <graphics supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sdl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vnc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>spice</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egl-headless</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </graphics>
Oct 20 11:28:49 user nova-compute[74241]:     <video supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='modelType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cirrus</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vmvga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>qxl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>none</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>bochs</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ramfb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </video>
Oct 20 11:28:49 user nova-compute[74241]:     <hostdev supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='mode'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>subsystem</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='startupPolicy'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>default</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>mandatory</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>requisite</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>optional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='subsysType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pci</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='capsType'/>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='pciBackend'/>
Oct 20 11:28:49 user nova-compute[74241]:     </hostdev>
Oct 20 11:28:49 user nova-compute[74241]:     <rng supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>random</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egd</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>builtin</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </rng>
Oct 20 11:28:49 user nova-compute[74241]:     <filesystem supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='driverType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>path</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>handle</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtiofs</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </filesystem>
Oct 20 11:28:49 user nova-compute[74241]:     <tpm supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-tis</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-crb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>passthrough</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>emulator</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </tpm>
Oct 20 11:28:49 user nova-compute[74241]:   </devices>
Oct 20 11:28:49 user nova-compute[74241]:   <features>
Oct 20 11:28:49 user nova-compute[74241]:     <gic supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <vmcoreinfo supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <genid supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backingStoreInput supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backup supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <sev supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:   </features>
Oct 20 11:28:49 user nova-compute[74241]: </domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 20 11:28:49 user nova-compute[74241]: <domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 11:28:49 user nova-compute[74241]:   <domain>kvm</domain>
Oct 20 11:28:49 user nova-compute[74241]:   <machine>pc-i440fx-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:   <arch>i686</arch>
Oct 20 11:28:49 user nova-compute[74241]:   <vcpu max='255'/>
Oct 20 11:28:49 user nova-compute[74241]:   <iothreads supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:   <os supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='firmware'/>
Oct 20 11:28:49 user nova-compute[74241]:     <loader supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>rom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pflash</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='readonly'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='secure'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </loader>
Oct 20 11:28:49 user nova-compute[74241]:   </os>
Oct 20 11:28:49 user nova-compute[74241]:   <cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-passthrough' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='hostPassthroughMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='maximum' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='maximumMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-model' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='umip'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibpb'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibrs'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='erms'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='lm'/>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='custom' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>qemu64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>qemu32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>phenom</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>n270</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>kvm64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>coreduo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>core2duo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>athlon</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Westmere</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Snowridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Penryn</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G5</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G4</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G1</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Rome</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Milan</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Dhyana</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cooperlake</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Conroe</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>486</model>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:   </cpu>
Oct 20 11:28:49 user nova-compute[74241]:   <memoryBacking supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='sourceType'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>file</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>anonymous</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>memfd</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:   </memoryBacking>
Oct 20 11:28:49 user nova-compute[74241]:   <devices>
Oct 20 11:28:49 user nova-compute[74241]:     <disk supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='diskDevice'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>disk</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cdrom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>floppy</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>lun</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='bus'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ide</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>fdc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sata</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </disk>
Oct 20 11:28:49 user nova-compute[74241]:     <graphics supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sdl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vnc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>spice</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egl-headless</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </graphics>
Oct 20 11:28:49 user nova-compute[74241]:     <video supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='modelType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cirrus</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vmvga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>qxl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>none</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>bochs</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ramfb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </video>
Oct 20 11:28:49 user nova-compute[74241]:     <hostdev supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='mode'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>subsystem</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='startupPolicy'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>default</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>mandatory</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>requisite</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>optional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='subsysType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pci</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='capsType'/>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='pciBackend'/>
Oct 20 11:28:49 user nova-compute[74241]:     </hostdev>
Oct 20 11:28:49 user nova-compute[74241]:     <rng supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>random</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egd</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>builtin</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </rng>
Oct 20 11:28:49 user nova-compute[74241]:     <filesystem supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='driverType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>path</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>handle</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtiofs</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </filesystem>
Oct 20 11:28:49 user nova-compute[74241]:     <tpm supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-tis</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-crb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>passthrough</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>emulator</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </tpm>
Oct 20 11:28:49 user nova-compute[74241]:   </devices>
Oct 20 11:28:49 user nova-compute[74241]:   <features>
Oct 20 11:28:49 user nova-compute[74241]:     <gic supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <vmcoreinfo supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <genid supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backingStoreInput supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backup supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <sev supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:   </features>
Oct 20 11:28:49 user nova-compute[74241]: </domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 20 11:28:49 user nova-compute[74241]: <domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 11:28:49 user nova-compute[74241]:   <domain>kvm</domain>
Oct 20 11:28:49 user nova-compute[74241]:   <machine>pc-i440fx-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:   <arch>i686</arch>
Oct 20 11:28:49 user nova-compute[74241]:   <vcpu max='255'/>
Oct 20 11:28:49 user nova-compute[74241]:   <iothreads supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:   <os supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='firmware'/>
Oct 20 11:28:49 user nova-compute[74241]:     <loader supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>rom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pflash</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='readonly'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='secure'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </loader>
Oct 20 11:28:49 user nova-compute[74241]:   </os>
Oct 20 11:28:49 user nova-compute[74241]:   <cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-passthrough' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='hostPassthroughMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='maximum' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='maximumMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-model' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='umip'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibpb'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibrs'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='erms'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='lm'/>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='custom' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>qemu64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>qemu32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>phenom</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>n270</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>kvm64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>coreduo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>core2duo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>athlon</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Westmere</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Snowridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Penryn</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G5</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G4</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G1</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Rome</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Milan</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Dhyana</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cooperlake</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Conroe</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>486</model>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:   </cpu>
Oct 20 11:28:49 user nova-compute[74241]:   <memoryBacking supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='sourceType'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>file</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>anonymous</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>memfd</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:   </memoryBacking>
Oct 20 11:28:49 user nova-compute[74241]:   <devices>
Oct 20 11:28:49 user nova-compute[74241]:     <disk supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='diskDevice'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>disk</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cdrom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>floppy</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>lun</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='bus'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ide</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>fdc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sata</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </disk>
Oct 20 11:28:49 user nova-compute[74241]:     <graphics supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sdl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vnc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>spice</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egl-headless</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </graphics>
Oct 20 11:28:49 user nova-compute[74241]:     <video supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='modelType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cirrus</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vmvga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>qxl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>none</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>bochs</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ramfb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </video>
Oct 20 11:28:49 user nova-compute[74241]:     <hostdev supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='mode'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>subsystem</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='startupPolicy'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>default</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>mandatory</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>requisite</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>optional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='subsysType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pci</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='capsType'/>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='pciBackend'/>
Oct 20 11:28:49 user nova-compute[74241]:     </hostdev>
Oct 20 11:28:49 user nova-compute[74241]:     <rng supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>random</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egd</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>builtin</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </rng>
Oct 20 11:28:49 user nova-compute[74241]:     <filesystem supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='driverType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>path</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>handle</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtiofs</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </filesystem>
Oct 20 11:28:49 user nova-compute[74241]:     <tpm supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-tis</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-crb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>passthrough</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>emulator</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </tpm>
Oct 20 11:28:49 user nova-compute[74241]:   </devices>
Oct 20 11:28:49 user nova-compute[74241]:   <features>
Oct 20 11:28:49 user nova-compute[74241]:     <gic supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <vmcoreinfo supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <genid supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backingStoreInput supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backup supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <sev supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:   </features>
Oct 20 11:28:49 user nova-compute[74241]: </domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 20 11:28:49 user nova-compute[74241]: <domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 11:28:49 user nova-compute[74241]:   <domain>kvm</domain>
Oct 20 11:28:49 user nova-compute[74241]:   <machine>pc-q35-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:   <arch>x86_64</arch>
Oct 20 11:28:49 user nova-compute[74241]:   <vcpu max='288'/>
Oct 20 11:28:49 user nova-compute[74241]:   <iothreads supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:   <os supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='firmware'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>efi</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:     <loader supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>rom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pflash</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='readonly'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='secure'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </loader>
Oct 20 11:28:49 user nova-compute[74241]:   </os>
Oct 20 11:28:49 user nova-compute[74241]:   <cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-passthrough' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='hostPassthroughMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='maximum' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='maximumMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-model' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='umip'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='invtsc'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibpb'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibrs'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='rsba'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='erms'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='custom' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>qemu64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>qemu32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>phenom</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>n270</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>coreduo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>core2duo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>athlon</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Westmere</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Snowridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Penryn</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G5</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G4</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Opteron_G1</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Rome</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Milan</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Dhyana</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cooperlake</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Conroe</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>486</model>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:   </cpu>
Oct 20 11:28:49 user nova-compute[74241]:   <memoryBacking supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='sourceType'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>file</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>anonymous</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>memfd</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:   </memoryBacking>
Oct 20 11:28:49 user nova-compute[74241]:   <devices>
Oct 20 11:28:49 user nova-compute[74241]:     <disk supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='diskDevice'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>disk</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cdrom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>floppy</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>lun</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='bus'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>fdc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sata</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </disk>
Oct 20 11:28:49 user nova-compute[74241]:     <graphics supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sdl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vnc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>spice</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egl-headless</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </graphics>
Oct 20 11:28:49 user nova-compute[74241]:     <video supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='modelType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cirrus</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vmvga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>qxl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>none</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>bochs</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ramfb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </video>
Oct 20 11:28:49 user nova-compute[74241]:     <hostdev supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='mode'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>subsystem</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='startupPolicy'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>default</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>mandatory</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>requisite</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>optional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='subsysType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pci</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='capsType'/>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='pciBackend'/>
Oct 20 11:28:49 user nova-compute[74241]:     </hostdev>
Oct 20 11:28:49 user nova-compute[74241]:     <rng supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>random</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egd</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>builtin</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </rng>
Oct 20 11:28:49 user nova-compute[74241]:     <filesystem supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='driverType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>path</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>handle</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtiofs</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </filesystem>
Oct 20 11:28:49 user nova-compute[74241]:     <tpm supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-tis</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-crb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>passthrough</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>emulator</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </tpm>
Oct 20 11:28:49 user nova-compute[74241]:   </devices>
Oct 20 11:28:49 user nova-compute[74241]:   <features>
Oct 20 11:28:49 user nova-compute[74241]:     <gic supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <vmcoreinfo supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <genid supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backingStoreInput supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backup supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <sev supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:   </features>
Oct 20 11:28:49 user nova-compute[74241]: </domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 20 11:28:49 user nova-compute[74241]: <domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 11:28:49 user nova-compute[74241]:   <domain>kvm</domain>
Oct 20 11:28:49 user nova-compute[74241]:   <machine>pc-q35-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:   <arch>x86_64</arch>
Oct 20 11:28:49 user nova-compute[74241]:   <vcpu max='288'/>
Oct 20 11:28:49 user nova-compute[74241]:   <iothreads supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:   <os supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='firmware'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>efi</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:     <loader supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>rom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pflash</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='readonly'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='secure'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </loader>
Oct 20 11:28:49 user nova-compute[74241]:   </os>
Oct 20 11:28:49 user nova-compute[74241]:   <cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-passthrough' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='hostPassthroughMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='maximum' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='maximumMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-model' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='umip'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='invtsc'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibpb'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibrs'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='rsba'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='erms'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='custom' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>qemu64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>qemu32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>phenom</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>n270</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>coreduo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>core2duo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>athlon</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Westmere</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Snowridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Penryn</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G5</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G4</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Opteron_G1</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Rome</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Milan</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Dhyana</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cooperlake</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Conroe</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>486</model>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:   </cpu>
Oct 20 11:28:49 user nova-compute[74241]:   <memoryBacking supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='sourceType'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>file</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>anonymous</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>memfd</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:   </memoryBacking>
Oct 20 11:28:49 user nova-compute[74241]:   <devices>
Oct 20 11:28:49 user nova-compute[74241]:     <disk supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='diskDevice'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>disk</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cdrom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>floppy</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>lun</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='bus'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>fdc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sata</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </disk>
Oct 20 11:28:49 user nova-compute[74241]:     <graphics supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sdl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vnc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>spice</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egl-headless</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </graphics>
Oct 20 11:28:49 user nova-compute[74241]:     <video supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='modelType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cirrus</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vmvga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>qxl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>none</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>bochs</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ramfb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </video>
Oct 20 11:28:49 user nova-compute[74241]:     <hostdev supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='mode'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>subsystem</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='startupPolicy'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>default</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>mandatory</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>requisite</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>optional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='subsysType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pci</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='capsType'/>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='pciBackend'/>
Oct 20 11:28:49 user nova-compute[74241]:     </hostdev>
Oct 20 11:28:49 user nova-compute[74241]:     <rng supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>random</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egd</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>builtin</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </rng>
Oct 20 11:28:49 user nova-compute[74241]:     <filesystem supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='driverType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>path</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>handle</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtiofs</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </filesystem>
Oct 20 11:28:49 user nova-compute[74241]:     <tpm supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-tis</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-crb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>passthrough</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>emulator</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </tpm>
Oct 20 11:28:49 user nova-compute[74241]:   </devices>
Oct 20 11:28:49 user nova-compute[74241]:   <features>
Oct 20 11:28:49 user nova-compute[74241]:     <gic supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <vmcoreinfo supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <genid supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backingStoreInput supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backup supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <sev supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:   </features>
Oct 20 11:28:49 user nova-compute[74241]: </domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 20 11:28:49 user nova-compute[74241]: <domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 11:28:49 user nova-compute[74241]:   <domain>kvm</domain>
Oct 20 11:28:49 user nova-compute[74241]:   <machine>pc-i440fx-6.2</machine>
Oct 20 11:28:49 user nova-compute[74241]:   <arch>x86_64</arch>
Oct 20 11:28:49 user nova-compute[74241]:   <vcpu max='255'/>
Oct 20 11:28:49 user nova-compute[74241]:   <iothreads supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:   <os supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='firmware'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>efi</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:     <loader supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>rom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pflash</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='readonly'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='secure'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </loader>
Oct 20 11:28:49 user nova-compute[74241]:   </os>
Oct 20 11:28:49 user nova-compute[74241]:   <cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-passthrough' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='hostPassthroughMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='maximum' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='maximumMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-model' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='umip'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='invtsc'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibpb'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibrs'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='rsba'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='erms'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='custom' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>qemu64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>qemu32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>phenom</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>n270</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>coreduo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>core2duo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>athlon</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Westmere</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Snowridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Penryn</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G5</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G4</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Opteron_G1</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Rome</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Milan</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Dhyana</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cooperlake</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Conroe</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>486</model>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:   </cpu>
Oct 20 11:28:49 user nova-compute[74241]:   <memoryBacking supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='sourceType'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>file</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>anonymous</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>memfd</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:   </memoryBacking>
Oct 20 11:28:49 user nova-compute[74241]:   <devices>
Oct 20 11:28:49 user nova-compute[74241]:     <disk supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='diskDevice'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>disk</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cdrom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>floppy</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>lun</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='bus'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ide</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>fdc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sata</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </disk>
Oct 20 11:28:49 user nova-compute[74241]:     <graphics supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sdl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vnc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>spice</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egl-headless</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </graphics>
Oct 20 11:28:49 user nova-compute[74241]:     <video supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='modelType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cirrus</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vmvga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>qxl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>none</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>bochs</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ramfb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </video>
Oct 20 11:28:49 user nova-compute[74241]:     <hostdev supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='mode'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>subsystem</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='startupPolicy'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>default</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>mandatory</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>requisite</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>optional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='subsysType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pci</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='capsType'/>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='pciBackend'/>
Oct 20 11:28:49 user nova-compute[74241]:     </hostdev>
Oct 20 11:28:49 user nova-compute[74241]:     <rng supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>random</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egd</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>builtin</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </rng>
Oct 20 11:28:49 user nova-compute[74241]:     <filesystem supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='driverType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>path</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>handle</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtiofs</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </filesystem>
Oct 20 11:28:49 user nova-compute[74241]:     <tpm supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-tis</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-crb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>passthrough</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>emulator</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </tpm>
Oct 20 11:28:49 user nova-compute[74241]:   </devices>
Oct 20 11:28:49 user nova-compute[74241]:   <features>
Oct 20 11:28:49 user nova-compute[74241]:     <gic supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <vmcoreinfo supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <genid supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backingStoreInput supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backup supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <sev supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:   </features>
Oct 20 11:28:49 user nova-compute[74241]: </domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 20 11:28:49 user nova-compute[74241]: <domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 11:28:49 user nova-compute[74241]:   <domain>kvm</domain>
Oct 20 11:28:49 user nova-compute[74241]:   <machine>pc-i440fx-jammy</machine>
Oct 20 11:28:49 user nova-compute[74241]:   <arch>x86_64</arch>
Oct 20 11:28:49 user nova-compute[74241]:   <vcpu max='255'/>
Oct 20 11:28:49 user nova-compute[74241]:   <iothreads supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:   <os supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='firmware'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>efi</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:     <loader supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>rom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pflash</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='readonly'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>yes</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='secure'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>no</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </loader>
Oct 20 11:28:49 user nova-compute[74241]:   </os>
Oct 20 11:28:49 user nova-compute[74241]:   <cpu>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-passthrough' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='hostPassthroughMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='maximum' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='maximumMigratable'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>on</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>off</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='host-model' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <vendor>Intel</vendor>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ss'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='vmx'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pcid'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='hypervisor'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arat'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='umip'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='md-clear'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='invtsc'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibpb'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='ibrs'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-stibp'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='rsba'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='erms'/>
Oct 20 11:28:49 user nova-compute[74241]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:     <mode name='custom' supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>qemu64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>qemu32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>phenom</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>pentium</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>n270</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm64</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>kvm32</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>coreduo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>core2duo</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>athlon</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Westmere</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Snowridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Skylake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>SandyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Penryn</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G5</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G4</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G3</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Opteron_G2</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Opteron_G1</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>IvyBridge</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Icelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Haswell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Rome</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-Milan</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>EPYC</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Dhyana</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cooperlake</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>Conroe</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='no'>Broadwell</model>
Oct 20 11:28:49 user nova-compute[74241]:       <model usable='yes'>486</model>
Oct 20 11:28:49 user nova-compute[74241]:     </mode>
Oct 20 11:28:49 user nova-compute[74241]:   </cpu>
Oct 20 11:28:49 user nova-compute[74241]:   <memoryBacking supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:     <enum name='sourceType'>
Oct 20 11:28:49 user nova-compute[74241]:       <value>file</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>anonymous</value>
Oct 20 11:28:49 user nova-compute[74241]:       <value>memfd</value>
Oct 20 11:28:49 user nova-compute[74241]:     </enum>
Oct 20 11:28:49 user nova-compute[74241]:   </memoryBacking>
Oct 20 11:28:49 user nova-compute[74241]:   <devices>
Oct 20 11:28:49 user nova-compute[74241]:     <disk supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='diskDevice'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>disk</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cdrom</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>floppy</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>lun</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='bus'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ide</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>fdc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sata</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </disk>
Oct 20 11:28:49 user nova-compute[74241]:     <graphics supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='type'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>sdl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vnc</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>spice</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egl-headless</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </graphics>
Oct 20 11:28:49 user nova-compute[74241]:     <video supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='modelType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>cirrus</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>vmvga</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>qxl</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>none</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>bochs</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>ramfb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </video>
Oct 20 11:28:49 user nova-compute[74241]:     <hostdev supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='mode'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>subsystem</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='startupPolicy'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>default</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>mandatory</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>requisite</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>optional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='subsysType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>usb</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>pci</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>scsi</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='capsType'/>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='pciBackend'/>
Oct 20 11:28:49 user nova-compute[74241]:     </hostdev>
Oct 20 11:28:49 user nova-compute[74241]:     <rng supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtio-non-transitional</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>random</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>egd</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>builtin</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </rng>
Oct 20 11:28:49 user nova-compute[74241]:     <filesystem supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='driverType'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>path</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>handle</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>virtiofs</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </filesystem>
Oct 20 11:28:49 user nova-compute[74241]:     <tpm supported='yes'>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='model'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-tis</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>tpm-crb</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:       <enum name='backendModel'>
Oct 20 11:28:49 user nova-compute[74241]:         <value>passthrough</value>
Oct 20 11:28:49 user nova-compute[74241]:         <value>emulator</value>
Oct 20 11:28:49 user nova-compute[74241]:       </enum>
Oct 20 11:28:49 user nova-compute[74241]:     </tpm>
Oct 20 11:28:49 user nova-compute[74241]:   </devices>
Oct 20 11:28:49 user nova-compute[74241]:   <features>
Oct 20 11:28:49 user nova-compute[74241]:     <gic supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:     <vmcoreinfo supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <genid supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backingStoreInput supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <backup supported='yes'/>
Oct 20 11:28:49 user nova-compute[74241]:     <sev supported='no'/>
Oct 20 11:28:49 user nova-compute[74241]:   </features>
Oct 20 11:28:49 user nova-compute[74241]: </domainCapabilities>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74241) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74241) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Checking secure boot support for host arch (x86_64) {{(pid=74241) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 11:28:49 user nova-compute[74241]: INFO nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Secure Boot support detected
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] cpu compare xml: <cpu match="exact">
Oct 20 11:28:49 user nova-compute[74241]:   <model>Nehalem</model>
Oct 20 11:28:49 user nova-compute[74241]: </cpu>
Oct 20 11:28:49 user nova-compute[74241]:  {{(pid=74241) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 20 11:28:49 user nova-compute[74241]: INFO nova.virt.node [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Generated node identity 34e63c41-61c0-494b-ac17-d5bfda3fa5f2
Oct 20 11:28:49 user nova-compute[74241]: INFO nova.virt.node [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Wrote node identity 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 to /opt/stack/data/nova/compute_id
Oct 20 11:28:49 user nova-compute[74241]: WARNING nova.compute.manager [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Compute nodes ['34e63c41-61c0-494b-ac17-d5bfda3fa5f2'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 20 11:28:49 user nova-compute[74241]: INFO nova.compute.manager [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 20 11:28:49 user nova-compute[74241]: WARNING nova.compute.manager [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 11:28:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:28:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:28:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:28:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Hypervisor/Node resource view: name=user free_ram=10996MB free_disk=26.254695892333984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:28:50 user nova-compute[74241]: WARNING nova.compute.resource_tracker [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] No compute node record for user:34e63c41-61c0-494b-ac17-d5bfda3fa5f2: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 could not be found.
Oct 20 11:28:50 user nova-compute[74241]: INFO nova.compute.resource_tracker [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Compute node record created for user:user with uuid: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:28:50 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] [req-1fc58ed2-c4b8-4867-8a15-c464c7a0a5e9] Created resource provider record via placement API for resource provider with UUID 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 and name user.
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74241) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 20 11:28:50 user nova-compute[74241]: INFO nova.virt.libvirt.host [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] kernel doesn't support AMD SEV
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Libvirt baseline CPU <cpu>
Oct 20 11:28:50 user nova-compute[74241]:   <arch>x86_64</arch>
Oct 20 11:28:50 user nova-compute[74241]:   <model>Nehalem</model>
Oct 20 11:28:50 user nova-compute[74241]:   <vendor>Intel</vendor>
Oct 20 11:28:50 user nova-compute[74241]:   <topology sockets="6" cores="1" threads="1"/>
Oct 20 11:28:50 user nova-compute[74241]: </cpu>
Oct 20 11:28:50 user nova-compute[74241]:  {{(pid=74241) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Updated inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Updating resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 generation from 0 to 1 during operation: update_inventory {{(pid=74241) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Updating resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 generation from 1 to 2 during operation: update_traits {{(pid=74241) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.service [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Creating RPC server for service compute {{(pid=74241) start /opt/stack/nova/nova/service.py:182}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.service [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] Join ServiceGroup membership for this service compute {{(pid=74241) start /opt/stack/nova/nova/service.py:199}}
Oct 20 11:28:50 user nova-compute[74241]: DEBUG nova.servicegroup.drivers.db [None req-24cace04-94bd-41ec-b164-414524fc5027 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74241) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 20 11:29:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:29:41 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:29:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:29:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:29:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=10426MB free_disk=26.15841293334961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:29:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:29:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:29:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:29:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:29:42 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:29:42 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:29:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:29:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:30:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:30:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=10367MB free_disk=26.223102569580078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:30:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:30:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:30:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:30:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:31:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:31:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:31:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:31:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:31:43 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:31:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=10341MB free_disk=25.976234436035156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:31:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:31:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:31:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:31:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:31:43 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:31:43 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:31:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:31:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:31:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:32:42 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:32:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:32:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:32:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9663MB free_disk=26.00442123413086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:32:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:32:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:32:43 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:32:43 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:32:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:32:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:32:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.313s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:32:57 user nova-compute[74241]: INFO nova.compute.claims [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Claim successful on node user
Oct 20 11:32:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.339s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:32:57 user nova-compute[74241]: INFO nova.compute.claims [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Claim successful on node user
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:32:57 user nova-compute[74241]: DEBUG nova.network.neutron [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:32:57 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:32:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Creating image(s)
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.policy [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43687383ff994fc5bea21a588209bf30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '948a6489aae6437cbcfbcd73857caa81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.764s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:32:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.virt.images [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] f9a80c7e-66e2-4915-96f8-63e828cf6c2e was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555.part /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555.part /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555.converted" returned: 0 in 0.186s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.policy [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd34d3bc237674577b870c03fe516a84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098fd658c3ab4b8dbec2354e04e50f26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:32:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:32:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Creating image(s)
Oct 20 11:32:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "/opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "/opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "/opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:32:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:32:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:32:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.938s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:32:59 user nova-compute[74241]: INFO oslo.privsep.daemon [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpot1j33b6/privsep.sock']
Oct 20 11:32:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.113s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:32:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:32:59 user sudo[83518]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpot1j33b6/privsep.sock
Oct 20 11:32:59 user sudo[83518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 11:33:00 user sudo[83518]: pam_unix(sudo:session): session closed for user root
Oct 20 11:33:00 user nova-compute[74241]: INFO oslo.privsep.daemon [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Spawned new privsep daemon via rootwrap
Oct 20 11:33:00 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 11:33:00 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 11:33:00 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 20 11:33:00 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83525
Oct 20 11:33:00 user nova-compute[74241]: WARNING oslo_privsep.priv_context [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] privsep daemon already running
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.206s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.network.neutron [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Successfully created port: 08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:33:01 user nova-compute[74241]: INFO nova.compute.claims [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Claim successful on node user
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk 1073741824" returned: 0 in 0.065s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Successfully created port: 4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.256s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk 1073741824" returned: 0 in 0.054s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Cannot resize image /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Ensure instance console log exists: /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:33:01 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Cannot resize image /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Ensure instance console log exists: /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:33:01 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Creating image(s)
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "/opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "/opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "/opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG nova.policy [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d7605635edc4cf9bddad897b8c18b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4449c61c4f64b2f96f4ac79b72c8f95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.157s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.235s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk 1073741824" returned: 0 in 0.046s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.164s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Cannot resize image /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Ensure instance console log exists: /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Successfully updated port: 08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:33:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:33:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:33:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-93f7b8dc-52e7-4041-a46c-6cf9dafa05b6 req-bbe30227-3b25-4ccc-a86d-4f1d33054917 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-changed-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-93f7b8dc-52e7-4041-a46c-6cf9dafa05b6 req-bbe30227-3b25-4ccc-a86d-4f1d33054917 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Refreshing instance network info cache due to event network-changed-08303d9d-06cf-4e8a-a348-f1475340cb3c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:33:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93f7b8dc-52e7-4041-a46c-6cf9dafa05b6 req-bbe30227-3b25-4ccc-a86d-4f1d33054917 service nova] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance network_info: |[{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93f7b8dc-52e7-4041-a46c-6cf9dafa05b6 req-bbe30227-3b25-4ccc-a86d-4f1d33054917 service nova] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.neutron [req-93f7b8dc-52e7-4041-a46c-6cf9dafa05b6 req-bbe30227-3b25-4ccc-a86d-4f1d33054917 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Refreshing network info cache for port 08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Start _get_guest_xml network_info=[{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:33:04 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:04 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-219899213',display_name='tempest-ServerStableDeviceRescueTest-server-219899213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-219899213',id=2,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/8WymVPDZxC9KfamWkU3H/nL3X9qJvU0cXONDpPlPtSbxrjqFJcKqA3LzbbDd//Q5fsnFeST6x7AHiBg7Md+G2s/LPWp5PU8eojSD2lO8Rz/5kZbTFOa0zvXzgC4RVLQ==',key_name='tempest-keypair-1870905534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='948a6489aae6437cbcfbcd73857caa81',ramdisk_id='',reservation_id='r-z37qlkwv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-89486859',owner_user_name='tempest-ServerStableDeviceRescueTest-89486859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43687383ff994fc5bea21a588209bf30',uuid=95bf8c4c-21a0-462c-a370-eedd74d6fc1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Converting VIF {"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=08303d9d-06cf-4e8a-a348-f1475340cb3c,network=Network(c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08303d9d-06') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.objects.instance [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'pci_devices' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:33:04 user nova-compute[74241]:   <uuid>95bf8c4c-21a0-462c-a370-eedd74d6fc1a</uuid>
Oct 20 11:33:04 user nova-compute[74241]:   <name>instance-00000002</name>
Oct 20 11:33:04 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:33:04 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:33:04 user nova-compute[74241]:   <metadata>
Oct 20 11:33:04 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:33:04 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:33:04 user nova-compute[74241]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-219899213</nova:name>
Oct 20 11:33:04 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:33:04</nova:creationTime>
Oct 20 11:33:04 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:33:04 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:33:04 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:33:04 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:33:04 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:33:04 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:33:04 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:33:04 user nova-compute[74241]:       <nova:owner>
Oct 20 11:33:04 user nova-compute[74241]:         <nova:user uuid="43687383ff994fc5bea21a588209bf30">tempest-ServerStableDeviceRescueTest-89486859-project-member</nova:user>
Oct 20 11:33:04 user nova-compute[74241]:         <nova:project uuid="948a6489aae6437cbcfbcd73857caa81">tempest-ServerStableDeviceRescueTest-89486859</nova:project>
Oct 20 11:33:04 user nova-compute[74241]:       </nova:owner>
Oct 20 11:33:04 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:33:04 user nova-compute[74241]:       <nova:ports>
Oct 20 11:33:04 user nova-compute[74241]:         <nova:port uuid="08303d9d-06cf-4e8a-a348-f1475340cb3c">
Oct 20 11:33:04 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 11:33:04 user nova-compute[74241]:         </nova:port>
Oct 20 11:33:04 user nova-compute[74241]:       </nova:ports>
Oct 20 11:33:04 user nova-compute[74241]:     </nova:instance>
Oct 20 11:33:04 user nova-compute[74241]:   </metadata>
Oct 20 11:33:04 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:33:04 user nova-compute[74241]:     <system>
Oct 20 11:33:04 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:33:04 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:33:04 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:33:04 user nova-compute[74241]:       <entry name="serial">95bf8c4c-21a0-462c-a370-eedd74d6fc1a</entry>
Oct 20 11:33:04 user nova-compute[74241]:       <entry name="uuid">95bf8c4c-21a0-462c-a370-eedd74d6fc1a</entry>
Oct 20 11:33:04 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:33:04 user nova-compute[74241]:     </system>
Oct 20 11:33:04 user nova-compute[74241]:   </sysinfo>
Oct 20 11:33:04 user nova-compute[74241]:   <os>
Oct 20 11:33:04 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:33:04 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:33:04 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:33:04 user nova-compute[74241]:   </os>
Oct 20 11:33:04 user nova-compute[74241]:   <features>
Oct 20 11:33:04 user nova-compute[74241]:     <acpi/>
Oct 20 11:33:04 user nova-compute[74241]:     <apic/>
Oct 20 11:33:04 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:33:04 user nova-compute[74241]:   </features>
Oct 20 11:33:04 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:33:04 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:33:04 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:33:04 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:33:04 user nova-compute[74241]:   </clock>
Oct 20 11:33:04 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:33:04 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:33:04 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:33:04 user nova-compute[74241]:   </cpu>
Oct 20 11:33:04 user nova-compute[74241]:   <devices>
Oct 20 11:33:04 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:33:04 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:33:04 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk"/>
Oct 20 11:33:04 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:33:04 user nova-compute[74241]:     </disk>
Oct 20 11:33:04 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:33:04 user nova-compute[74241]:       <mac address="fa:16:3e:00:c5:3e"/>
Oct 20 11:33:04 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:04 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:33:04 user nova-compute[74241]:       <target dev="tap08303d9d-06"/>
Oct 20 11:33:04 user nova-compute[74241]:     </interface>
Oct 20 11:33:04 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:33:04 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/console.log" append="off"/>
Oct 20 11:33:04 user nova-compute[74241]:     </serial>
Oct 20 11:33:04 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:33:04 user nova-compute[74241]:     <video>
Oct 20 11:33:04 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:04 user nova-compute[74241]:     </video>
Oct 20 11:33:04 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:33:04 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:33:04 user nova-compute[74241]:     </rng>
Oct 20 11:33:04 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:33:04 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:33:04 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:33:04 user nova-compute[74241]:     </memballoon>
Oct 20 11:33:04 user nova-compute[74241]:   </devices>
Oct 20 11:33:04 user nova-compute[74241]: </domain>
Oct 20 11:33:04 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-219899213',display_name='tempest-ServerStableDeviceRescueTest-server-219899213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-219899213',id=2,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/8WymVPDZxC9KfamWkU3H/nL3X9qJvU0cXONDpPlPtSbxrjqFJcKqA3LzbbDd//Q5fsnFeST6x7AHiBg7Md+G2s/LPWp5PU8eojSD2lO8Rz/5kZbTFOa0zvXzgC4RVLQ==',key_name='tempest-keypair-1870905534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='948a6489aae6437cbcfbcd73857caa81',ramdisk_id='',reservation_id='r-z37qlkwv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-89486859',owner_user_name='tempest-ServerStableDeviceRescueTest-89486859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43687383ff994fc5bea21a588209bf30',uuid=95bf8c4c-21a0-462c-a370-eedd74d6fc1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Converting VIF {"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=08303d9d-06cf-4e8a-a348-f1475340cb3c,network=Network(c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08303d9d-06') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG os_vif [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=08303d9d-06cf-4e8a-a348-f1475340cb3c,network=Network(c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08303d9d-06') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Successfully updated port: 4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Created schema index Interface.name {{(pid=74241) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Created schema index Port.name {{(pid=74241) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Created schema index Bridge.name {{(pid=74241) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [POLLOUT] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquired lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95cd0025-190f-5713-a8a8-785e67698274', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: INFO oslo.privsep.daemon [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_mhip74u/privsep.sock']
Oct 20 11:33:04 user sudo[83580]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_mhip74u/privsep.sock
Oct 20 11:33:04 user sudo[83580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 11:33:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-20dd6706-ce47-4d73-b395-4f60ee27d98d req-397737fb-2f4a-46fc-b15b-a481e91b72d6 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received event network-changed-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-20dd6706-ce47-4d73-b395-4f60ee27d98d req-397737fb-2f4a-46fc-b15b-a481e91b72d6 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Refreshing instance network info cache due to event network-changed-4136cb20-f54d-4fd3-ba90-5b4fc294778a. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:33:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-20dd6706-ce47-4d73-b395-4f60ee27d98d req-397737fb-2f4a-46fc-b15b-a481e91b72d6 service nova] Acquiring lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Successfully created port: 504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.neutron [req-93f7b8dc-52e7-4041-a46c-6cf9dafa05b6 req-bbe30227-3b25-4ccc-a86d-4f1d33054917 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updated VIF entry in instance network info cache for port 08303d9d-06cf-4e8a-a348-f1475340cb3c. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.neutron [req-93f7b8dc-52e7-4041-a46c-6cf9dafa05b6 req-bbe30227-3b25-4ccc-a86d-4f1d33054917 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93f7b8dc-52e7-4041-a46c-6cf9dafa05b6 req-bbe30227-3b25-4ccc-a86d-4f1d33054917 service nova] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Updating instance_info_cache with network_info: [{"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Releasing lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Instance network_info: |[{"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-20dd6706-ce47-4d73-b395-4f60ee27d98d req-397737fb-2f4a-46fc-b15b-a481e91b72d6 service nova] Acquired lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.neutron [req-20dd6706-ce47-4d73-b395-4f60ee27d98d req-397737fb-2f4a-46fc-b15b-a481e91b72d6 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Refreshing network info cache for port 4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Start _get_guest_xml network_info=[{"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:33:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-622124846',display_name='tempest-DeleteServersTestJSON-server-622124846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-622124846',id=1,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='098fd658c3ab4b8dbec2354e04e50f26',ramdisk_id='',reservation_id='r-4ucgk79m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-263461688',owner_user_name='tempest-DeleteServersTestJSON-263461688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:32:59Z,user_data=None,user_id='d34d3bc237674577b870c03fe516a84d',uuid=6a1b5fb2-449e-4648-8dc0-276813417b1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Converting VIF {"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=4136cb20-f54d-4fd3-ba90-5b4fc294778a,network=Network(0d3f4b36-5087-4b22-8beb-9cc2f6d4638b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136cb20-f5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a1b5fb2-449e-4648-8dc0-276813417b1d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:33:05 user nova-compute[74241]:   <uuid>6a1b5fb2-449e-4648-8dc0-276813417b1d</uuid>
Oct 20 11:33:05 user nova-compute[74241]:   <name>instance-00000001</name>
Oct 20 11:33:05 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:33:05 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:33:05 user nova-compute[74241]:   <metadata>
Oct 20 11:33:05 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:33:05 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:33:05 user nova-compute[74241]:       <nova:name>tempest-DeleteServersTestJSON-server-622124846</nova:name>
Oct 20 11:33:05 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:33:05</nova:creationTime>
Oct 20 11:33:05 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:33:05 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:33:05 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:33:05 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:33:05 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:33:05 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:33:05 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:33:05 user nova-compute[74241]:       <nova:owner>
Oct 20 11:33:05 user nova-compute[74241]:         <nova:user uuid="d34d3bc237674577b870c03fe516a84d">tempest-DeleteServersTestJSON-263461688-project-member</nova:user>
Oct 20 11:33:05 user nova-compute[74241]:         <nova:project uuid="098fd658c3ab4b8dbec2354e04e50f26">tempest-DeleteServersTestJSON-263461688</nova:project>
Oct 20 11:33:05 user nova-compute[74241]:       </nova:owner>
Oct 20 11:33:05 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:33:05 user nova-compute[74241]:       <nova:ports>
Oct 20 11:33:05 user nova-compute[74241]:         <nova:port uuid="4136cb20-f54d-4fd3-ba90-5b4fc294778a">
Oct 20 11:33:05 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 11:33:05 user nova-compute[74241]:         </nova:port>
Oct 20 11:33:05 user nova-compute[74241]:       </nova:ports>
Oct 20 11:33:05 user nova-compute[74241]:     </nova:instance>
Oct 20 11:33:05 user nova-compute[74241]:   </metadata>
Oct 20 11:33:05 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:33:05 user nova-compute[74241]:     <system>
Oct 20 11:33:05 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:33:05 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:33:05 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:33:05 user nova-compute[74241]:       <entry name="serial">6a1b5fb2-449e-4648-8dc0-276813417b1d</entry>
Oct 20 11:33:05 user nova-compute[74241]:       <entry name="uuid">6a1b5fb2-449e-4648-8dc0-276813417b1d</entry>
Oct 20 11:33:05 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:33:05 user nova-compute[74241]:     </system>
Oct 20 11:33:05 user nova-compute[74241]:   </sysinfo>
Oct 20 11:33:05 user nova-compute[74241]:   <os>
Oct 20 11:33:05 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:33:05 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:33:05 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:33:05 user nova-compute[74241]:   </os>
Oct 20 11:33:05 user nova-compute[74241]:   <features>
Oct 20 11:33:05 user nova-compute[74241]:     <acpi/>
Oct 20 11:33:05 user nova-compute[74241]:     <apic/>
Oct 20 11:33:05 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:33:05 user nova-compute[74241]:   </features>
Oct 20 11:33:05 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:33:05 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:33:05 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:33:05 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:33:05 user nova-compute[74241]:   </clock>
Oct 20 11:33:05 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:33:05 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:33:05 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:33:05 user nova-compute[74241]:   </cpu>
Oct 20 11:33:05 user nova-compute[74241]:   <devices>
Oct 20 11:33:05 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:33:05 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:33:05 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk"/>
Oct 20 11:33:05 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:33:05 user nova-compute[74241]:     </disk>
Oct 20 11:33:05 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:33:05 user nova-compute[74241]:       <mac address="fa:16:3e:b2:e5:2b"/>
Oct 20 11:33:05 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:05 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:33:05 user nova-compute[74241]:       <target dev="tap4136cb20-f5"/>
Oct 20 11:33:05 user nova-compute[74241]:     </interface>
Oct 20 11:33:05 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:33:05 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/console.log" append="off"/>
Oct 20 11:33:05 user nova-compute[74241]:     </serial>
Oct 20 11:33:05 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:33:05 user nova-compute[74241]:     <video>
Oct 20 11:33:05 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:05 user nova-compute[74241]:     </video>
Oct 20 11:33:05 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:33:05 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:33:05 user nova-compute[74241]:     </rng>
Oct 20 11:33:05 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:33:05 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:33:05 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:33:05 user nova-compute[74241]:     </memballoon>
Oct 20 11:33:05 user nova-compute[74241]:   </devices>
Oct 20 11:33:05 user nova-compute[74241]: </domain>
Oct 20 11:33:05 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-622124846',display_name='tempest-DeleteServersTestJSON-server-622124846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-622124846',id=1,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='098fd658c3ab4b8dbec2354e04e50f26',ramdisk_id='',reservation_id='r-4ucgk79m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-263461688',owner_user_name='tempest-DeleteServersTestJSON-263461688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:32:59Z,user_data=None,user_id='d34d3bc237674577b870c03fe516a84d',uuid=6a1b5fb2-449e-4648-8dc0-276813417b1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Converting VIF {"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=4136cb20-f54d-4fd3-ba90-5b4fc294778a,network=Network(0d3f4b36-5087-4b22-8beb-9cc2f6d4638b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136cb20-f5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG os_vif [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=4136cb20-f54d-4fd3-ba90-5b4fc294778a,network=Network(0d3f4b36-5087-4b22-8beb-9cc2f6d4638b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136cb20-f5') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1991c9d-707d-54d5-aeef-4cd302c6c446', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:05 user sudo[83580]: pam_unix(sudo:session): session closed for user root
Oct 20 11:33:05 user nova-compute[74241]: INFO oslo.privsep.daemon [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Spawned new privsep daemon via rootwrap
Oct 20 11:33:05 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 11:33:05 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 11:33:05 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 20 11:33:05 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83593
Oct 20 11:33:05 user nova-compute[74241]: WARNING oslo_privsep.priv_context [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] privsep daemon already running
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4136cb20-f5, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4136cb20-f5, col_values=(('qos', UUID('3bcfac62-5b9c-43b2-8c84-d8bf768fadb9')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4136cb20-f5, col_values=(('external_ids', {'iface-id': '4136cb20-f54d-4fd3-ba90-5b4fc294778a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:e5:2b', 'vm-uuid': '6a1b5fb2-449e-4648-8dc0-276813417b1d'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:06 user nova-compute[74241]: INFO os_vif [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=4136cb20-f54d-4fd3-ba90-5b4fc294778a,network=Network(0d3f4b36-5087-4b22-8beb-9cc2f6d4638b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136cb20-f5')
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08303d9d-06, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08303d9d-06, col_values=(('qos', UUID('4b350750-3fb2-40ea-9628-ec30b59d2ca7')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08303d9d-06, col_values=(('external_ids', {'iface-id': '08303d9d-06cf-4e8a-a348-f1475340cb3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:c5:3e', 'vm-uuid': '95bf8c4c-21a0-462c-a370-eedd74d6fc1a'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:06 user nova-compute[74241]: INFO os_vif [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=08303d9d-06cf-4e8a-a348-f1475340cb3c,network=Network(c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08303d9d-06')
Oct 20 11:33:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] No VIF found with MAC fa:16:3e:b2:e5:2b, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No VIF found with MAC fa:16:3e:00:c5:3e, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-20dd6706-ce47-4d73-b395-4f60ee27d98d req-397737fb-2f4a-46fc-b15b-a481e91b72d6 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Updated VIF entry in instance network info cache for port 4136cb20-f54d-4fd3-ba90-5b4fc294778a. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-20dd6706-ce47-4d73-b395-4f60ee27d98d req-397737fb-2f4a-46fc-b15b-a481e91b72d6 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Updating instance_info_cache with network_info: [{"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-20dd6706-ce47-4d73-b395-4f60ee27d98d req-397737fb-2f4a-46fc-b15b-a481e91b72d6 service nova] Releasing lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Successfully updated port: 504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:33:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquired lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:33:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:33:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-cd3f0e2e-553a-4059-bb0f-84e4306b4aa7 req-cb5b7260-db63-474f-947c-e3b860ce2d2f service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-changed-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-cd3f0e2e-553a-4059-bb0f-84e4306b4aa7 req-cb5b7260-db63-474f-947c-e3b860ce2d2f service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Refreshing instance network info cache due to event network-changed-504064ac-206b-4ceb-9eb0-e87b8bfee408. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:33:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cd3f0e2e-553a-4059-bb0f-84e4306b4aa7 req-cb5b7260-db63-474f-947c-e3b860ce2d2f service nova] Acquiring lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Releasing lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Instance network_info: |[{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cd3f0e2e-553a-4059-bb0f-84e4306b4aa7 req-cb5b7260-db63-474f-947c-e3b860ce2d2f service nova] Acquired lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.network.neutron [req-cd3f0e2e-553a-4059-bb0f-84e4306b4aa7 req-cb5b7260-db63-474f-947c-e3b860ce2d2f service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Refreshing network info cache for port 504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Start _get_guest_xml network_info=[{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:33:10 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:10 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-6794331',display_name='tempest-ServerActionsTestOtherA-server-6794331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-6794331',id=3,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-u9hr9b5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=f289e23f-cab7-4631-9c80-6b0391bbea89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c7:3a,bridge_name='br-int',has_traffic_filtering=True,id=504064ac-206b-4ceb-9eb0-e87b8bfee408,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504064ac-20') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'pci_devices' on Instance uuid f289e23f-cab7-4631-9c80-6b0391bbea89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:33:10 user nova-compute[74241]:   <uuid>f289e23f-cab7-4631-9c80-6b0391bbea89</uuid>
Oct 20 11:33:10 user nova-compute[74241]:   <name>instance-00000003</name>
Oct 20 11:33:10 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:33:10 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:33:10 user nova-compute[74241]:   <metadata>
Oct 20 11:33:10 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:33:10 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:33:10 user nova-compute[74241]:       <nova:name>tempest-ServerActionsTestOtherA-server-6794331</nova:name>
Oct 20 11:33:10 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:33:10</nova:creationTime>
Oct 20 11:33:10 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:33:10 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:33:10 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:33:10 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:33:10 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:33:10 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:33:10 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:33:10 user nova-compute[74241]:       <nova:owner>
Oct 20 11:33:10 user nova-compute[74241]:         <nova:user uuid="3d7605635edc4cf9bddad897b8c18b77">tempest-ServerActionsTestOtherA-1364765065-project-member</nova:user>
Oct 20 11:33:10 user nova-compute[74241]:         <nova:project uuid="f4449c61c4f64b2f96f4ac79b72c8f95">tempest-ServerActionsTestOtherA-1364765065</nova:project>
Oct 20 11:33:10 user nova-compute[74241]:       </nova:owner>
Oct 20 11:33:10 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:33:10 user nova-compute[74241]:       <nova:ports>
Oct 20 11:33:10 user nova-compute[74241]:         <nova:port uuid="504064ac-206b-4ceb-9eb0-e87b8bfee408">
Oct 20 11:33:10 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 11:33:10 user nova-compute[74241]:         </nova:port>
Oct 20 11:33:10 user nova-compute[74241]:       </nova:ports>
Oct 20 11:33:10 user nova-compute[74241]:     </nova:instance>
Oct 20 11:33:10 user nova-compute[74241]:   </metadata>
Oct 20 11:33:10 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:33:10 user nova-compute[74241]:     <system>
Oct 20 11:33:10 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:33:10 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:33:10 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:33:10 user nova-compute[74241]:       <entry name="serial">f289e23f-cab7-4631-9c80-6b0391bbea89</entry>
Oct 20 11:33:10 user nova-compute[74241]:       <entry name="uuid">f289e23f-cab7-4631-9c80-6b0391bbea89</entry>
Oct 20 11:33:10 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:33:10 user nova-compute[74241]:     </system>
Oct 20 11:33:10 user nova-compute[74241]:   </sysinfo>
Oct 20 11:33:10 user nova-compute[74241]:   <os>
Oct 20 11:33:10 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:33:10 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:33:10 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:33:10 user nova-compute[74241]:   </os>
Oct 20 11:33:10 user nova-compute[74241]:   <features>
Oct 20 11:33:10 user nova-compute[74241]:     <acpi/>
Oct 20 11:33:10 user nova-compute[74241]:     <apic/>
Oct 20 11:33:10 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:33:10 user nova-compute[74241]:   </features>
Oct 20 11:33:10 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:33:10 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:33:10 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:33:10 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:33:10 user nova-compute[74241]:   </clock>
Oct 20 11:33:10 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:33:10 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:33:10 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:33:10 user nova-compute[74241]:   </cpu>
Oct 20 11:33:10 user nova-compute[74241]:   <devices>
Oct 20 11:33:10 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:33:10 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:33:10 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk"/>
Oct 20 11:33:10 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:33:10 user nova-compute[74241]:     </disk>
Oct 20 11:33:10 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:33:10 user nova-compute[74241]:       <mac address="fa:16:3e:20:c7:3a"/>
Oct 20 11:33:10 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:10 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:33:10 user nova-compute[74241]:       <target dev="tap504064ac-20"/>
Oct 20 11:33:10 user nova-compute[74241]:     </interface>
Oct 20 11:33:10 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:33:10 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/console.log" append="off"/>
Oct 20 11:33:10 user nova-compute[74241]:     </serial>
Oct 20 11:33:10 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:33:10 user nova-compute[74241]:     <video>
Oct 20 11:33:10 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:10 user nova-compute[74241]:     </video>
Oct 20 11:33:10 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:33:10 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:33:10 user nova-compute[74241]:     </rng>
Oct 20 11:33:10 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:33:10 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:33:10 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:33:10 user nova-compute[74241]:     </memballoon>
Oct 20 11:33:10 user nova-compute[74241]:   </devices>
Oct 20 11:33:10 user nova-compute[74241]: </domain>
Oct 20 11:33:10 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-6794331',display_name='tempest-ServerActionsTestOtherA-server-6794331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-6794331',id=3,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-u9hr9b5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=f289e23f-cab7-4631-9c80-6b0391bbea89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:c7:3a,bridge_name='br-int',has_traffic_filtering=True,id=504064ac-206b-4ceb-9eb0-e87b8bfee408,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504064ac-20') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG os_vif [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c7:3a,bridge_name='br-int',has_traffic_filtering=True,id=504064ac-206b-4ceb-9eb0-e87b8bfee408,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504064ac-20') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ab36dd5-7c27-5839-be9f-d559460279ae', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap504064ac-20, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap504064ac-20, col_values=(('qos', UUID('1dd9179e-9cc3-4e2e-b389-c8968a95eaca')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap504064ac-20, col_values=(('external_ids', {'iface-id': '504064ac-206b-4ceb-9eb0-e87b8bfee408', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:c7:3a', 'vm-uuid': 'f289e23f-cab7-4631-9c80-6b0391bbea89'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:10 user nova-compute[74241]: INFO os_vif [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:c7:3a,bridge_name='br-int',has_traffic_filtering=True,id=504064ac-206b-4ceb-9eb0-e87b8bfee408,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504064ac-20')
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No VIF found with MAC fa:16:3e:20:c7:3a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:33:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance spawned successfully.
Oct 20 11:33:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:33:11 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Instance spawned successfully.
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:11 user nova-compute[74241]: INFO nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Took 13.06 seconds to spawn the instance on the hypervisor.
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:33:11 user nova-compute[74241]: INFO nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Took 12.24 seconds to spawn the instance on the hypervisor.
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:11 user nova-compute[74241]: INFO nova.compute.manager [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Took 13.93 seconds to build instance.
Oct 20 11:33:11 user nova-compute[74241]: INFO nova.compute.manager [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Took 13.95 seconds to build instance.
Oct 20 11:33:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71005a98-2062-4d0a-bc40-6d396d197f18 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.302s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4cfd691b-f3b7-4f08-be94-0d2f291d6c3d tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.640s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.network.neutron [req-cd3f0e2e-553a-4059-bb0f-84e4306b4aa7 req-cb5b7260-db63-474f-947c-e3b860ce2d2f service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updated VIF entry in instance network info cache for port 504064ac-206b-4ceb-9eb0-e87b8bfee408. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG nova.network.neutron [req-cd3f0e2e-553a-4059-bb0f-84e4306b4aa7 req-cb5b7260-db63-474f-947c-e3b860ce2d2f service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cd3f0e2e-553a-4059-bb0f-84e4306b4aa7 req-cb5b7260-db63-474f-947c-e3b860ce2d2f service nova] Releasing lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:33:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Instance spawned successfully.
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:15 user nova-compute[74241]: INFO nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Took 13.45 seconds to spawn the instance on the hypervisor.
Oct 20 11:33:15 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:33:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:15 user nova-compute[74241]: INFO nova.compute.manager [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Took 14.52 seconds to build instance.
Oct 20 11:33:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d22f666a-228a-4d13-b37c-e03a1affce7c tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.772s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:33:16 user nova-compute[74241]: INFO nova.compute.claims [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Claim successful on node user
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.743s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:33:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.policy [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '555d42ae165f487a9fe068dd8b06e6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b0bf8e61964896a236f83d739a7366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:33:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Creating image(s)
Oct 20 11:33:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "/opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "/opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.353s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.240s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk 1073741824" returned: 0 in 0.077s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.318s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:19 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Cannot resize image /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:33:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:33:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Ensure instance console log exists: /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:33:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.012s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Successfully created port: 491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:33:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:20 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Successfully updated port: 491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:33:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquired lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:20 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:33:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-ee3aec6e-f63b-4df0-b7c1-cbd9efeebe61 req-c6ce1bd7-ba04-4963-a074-bd093560f610 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received event network-changed-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-ee3aec6e-f63b-4df0-b7c1-cbd9efeebe61 req-c6ce1bd7-ba04-4963-a074-bd093560f610 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Refreshing instance network info cache due to event network-changed-491c6c41-5608-42cd-a9d5-a1893dbbacf9. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:33:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ee3aec6e-f63b-4df0-b7c1-cbd9efeebe61 req-c6ce1bd7-ba04-4963-a074-bd093560f610 service nova] Acquiring lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:21 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:33:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updating instance_info_cache with network_info: [{"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Releasing lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Instance network_info: |[{"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ee3aec6e-f63b-4df0-b7c1-cbd9efeebe61 req-c6ce1bd7-ba04-4963-a074-bd093560f610 service nova] Acquired lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.network.neutron [req-ee3aec6e-f63b-4df0-b7c1-cbd9efeebe61 req-c6ce1bd7-ba04-4963-a074-bd093560f610 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Refreshing network info cache for port 491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Start _get_guest_xml network_info=[{"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:33:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1009283430',display_name='tempest-VolumesAdminNegativeTest-server-1009283430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1009283430',id=4,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU6Kh2QbgahCSNiMzVaw3Di8NRILNAz1OKj0+CYZZqWDru/1JJFt1cZfIvPmdLFDxQv8L8c++J2xYlaZjV6LQlGPGcSx7D5eH4FVK7v59c7mAwEjy8IZq4mYCJsAeQDRA==',key_name='tempest-keypair-522061344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42b0bf8e61964896a236f83d739a7366',ramdisk_id='',reservation_id='r-oow34t0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-617790048',owner_user_name='tempest-VolumesAdminNegativeTest-617790048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555d42ae165f487a9fe068dd8b06e6cc',uuid=3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converting VIF {"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:53:8b,bridge_name='br-int',has_traffic_filtering=True,id=491c6c41-5608-42cd-a9d5-a1893dbbacf9,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491c6c41-56') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.objects.instance [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:33:22 user nova-compute[74241]:   <uuid>3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d</uuid>
Oct 20 11:33:22 user nova-compute[74241]:   <name>instance-00000004</name>
Oct 20 11:33:22 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:33:22 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:33:22 user nova-compute[74241]:   <metadata>
Oct 20 11:33:22 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:33:22 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:33:22 user nova-compute[74241]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1009283430</nova:name>
Oct 20 11:33:22 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:33:22</nova:creationTime>
Oct 20 11:33:22 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:33:22 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:33:22 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:33:22 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:33:22 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:33:22 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:33:22 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:33:22 user nova-compute[74241]:       <nova:owner>
Oct 20 11:33:22 user nova-compute[74241]:         <nova:user uuid="555d42ae165f487a9fe068dd8b06e6cc">tempest-VolumesAdminNegativeTest-617790048-project-member</nova:user>
Oct 20 11:33:22 user nova-compute[74241]:         <nova:project uuid="42b0bf8e61964896a236f83d739a7366">tempest-VolumesAdminNegativeTest-617790048</nova:project>
Oct 20 11:33:22 user nova-compute[74241]:       </nova:owner>
Oct 20 11:33:22 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:33:22 user nova-compute[74241]:       <nova:ports>
Oct 20 11:33:22 user nova-compute[74241]:         <nova:port uuid="491c6c41-5608-42cd-a9d5-a1893dbbacf9">
Oct 20 11:33:22 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:33:22 user nova-compute[74241]:         </nova:port>
Oct 20 11:33:22 user nova-compute[74241]:       </nova:ports>
Oct 20 11:33:22 user nova-compute[74241]:     </nova:instance>
Oct 20 11:33:22 user nova-compute[74241]:   </metadata>
Oct 20 11:33:22 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:33:22 user nova-compute[74241]:     <system>
Oct 20 11:33:22 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:33:22 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:33:22 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:33:22 user nova-compute[74241]:       <entry name="serial">3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d</entry>
Oct 20 11:33:22 user nova-compute[74241]:       <entry name="uuid">3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d</entry>
Oct 20 11:33:22 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:33:22 user nova-compute[74241]:     </system>
Oct 20 11:33:22 user nova-compute[74241]:   </sysinfo>
Oct 20 11:33:22 user nova-compute[74241]:   <os>
Oct 20 11:33:22 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:33:22 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:33:22 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:33:22 user nova-compute[74241]:   </os>
Oct 20 11:33:22 user nova-compute[74241]:   <features>
Oct 20 11:33:22 user nova-compute[74241]:     <acpi/>
Oct 20 11:33:22 user nova-compute[74241]:     <apic/>
Oct 20 11:33:22 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:33:22 user nova-compute[74241]:   </features>
Oct 20 11:33:22 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:33:22 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:33:22 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:33:22 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:33:22 user nova-compute[74241]:   </clock>
Oct 20 11:33:22 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:33:22 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:33:22 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:33:22 user nova-compute[74241]:   </cpu>
Oct 20 11:33:22 user nova-compute[74241]:   <devices>
Oct 20 11:33:22 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:33:22 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:33:22 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk"/>
Oct 20 11:33:22 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:33:22 user nova-compute[74241]:     </disk>
Oct 20 11:33:22 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:33:22 user nova-compute[74241]:       <mac address="fa:16:3e:93:53:8b"/>
Oct 20 11:33:22 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:22 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:33:22 user nova-compute[74241]:       <target dev="tap491c6c41-56"/>
Oct 20 11:33:22 user nova-compute[74241]:     </interface>
Oct 20 11:33:22 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:33:22 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/console.log" append="off"/>
Oct 20 11:33:22 user nova-compute[74241]:     </serial>
Oct 20 11:33:22 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:33:22 user nova-compute[74241]:     <video>
Oct 20 11:33:22 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:22 user nova-compute[74241]:     </video>
Oct 20 11:33:22 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:33:22 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:33:22 user nova-compute[74241]:     </rng>
Oct 20 11:33:22 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:33:22 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:33:22 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:33:22 user nova-compute[74241]:     </memballoon>
Oct 20 11:33:22 user nova-compute[74241]:   </devices>
Oct 20 11:33:22 user nova-compute[74241]: </domain>
Oct 20 11:33:22 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1009283430',display_name='tempest-VolumesAdminNegativeTest-server-1009283430',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1009283430',id=4,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU6Kh2QbgahCSNiMzVaw3Di8NRILNAz1OKj0+CYZZqWDru/1JJFt1cZfIvPmdLFDxQv8L8c++J2xYlaZjV6LQlGPGcSx7D5eH4FVK7v59c7mAwEjy8IZq4mYCJsAeQDRA==',key_name='tempest-keypair-522061344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42b0bf8e61964896a236f83d739a7366',ramdisk_id='',reservation_id='r-oow34t0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-617790048',owner_user_name='tempest-VolumesAdminNegativeTest-617790048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555d42ae165f487a9fe068dd8b06e6cc',uuid=3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converting VIF {"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:53:8b,bridge_name='br-int',has_traffic_filtering=True,id=491c6c41-5608-42cd-a9d5-a1893dbbacf9,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491c6c41-56') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG os_vif [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:53:8b,bridge_name='br-int',has_traffic_filtering=True,id=491c6c41-5608-42cd-a9d5-a1893dbbacf9,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491c6c41-56') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b7b3fa4-a98c-5983-96d4-07d6971e9bc1', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap491c6c41-56, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap491c6c41-56, col_values=(('qos', UUID('df28e83f-3a65-4c2d-a981-061f87e822e2')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap491c6c41-56, col_values=(('external_ids', {'iface-id': '491c6c41-5608-42cd-a9d5-a1893dbbacf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:53:8b', 'vm-uuid': '3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:22 user nova-compute[74241]: INFO os_vif [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:53:8b,bridge_name='br-int',has_traffic_filtering=True,id=491c6c41-5608-42cd-a9d5-a1893dbbacf9,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491c6c41-56')
Oct 20 11:33:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] No VIF found with MAC fa:16:3e:93:53:8b, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:33:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.005s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:23 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:33:23 user nova-compute[74241]: DEBUG nova.network.neutron [req-ee3aec6e-f63b-4df0-b7c1-cbd9efeebe61 req-c6ce1bd7-ba04-4963-a074-bd093560f610 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updated VIF entry in instance network info cache for port 491c6c41-5608-42cd-a9d5-a1893dbbacf9. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:33:23 user nova-compute[74241]: DEBUG nova.network.neutron [req-ee3aec6e-f63b-4df0-b7c1-cbd9efeebe61 req-c6ce1bd7-ba04-4963-a074-bd093560f610 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updating instance_info_cache with network_info: [{"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ee3aec6e-f63b-4df0-b7c1-cbd9efeebe61 req-c6ce1bd7-ba04-4963-a074-bd093560f610 service nova] Releasing lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:33:24 user nova-compute[74241]: INFO nova.compute.claims [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Claim successful on node user
Oct 20 11:33:24 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:24 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:33:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:33:24 user nova-compute[74241]: DEBUG nova.policy [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54ab4dcd0a5c44f1a3cf8f56918dba0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846710235ea147a09c582fe0709848e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:33:25 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Creating image(s)
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "/opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "/opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "/opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.225s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.280s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk 1073741824" returned: 0 in 0.132s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.432s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.247s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:33:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Cannot resize image /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Ensure instance console log exists: /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-46ef6ee4-4fad-4818-b190-17e4cf2a587b req-4a3a8618-8d26-4435-ab33-410568639152 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-46ef6ee4-4fad-4818-b190-17e4cf2a587b req-4a3a8618-8d26-4435-ab33-410568639152 service nova] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-46ef6ee4-4fad-4818-b190-17e4cf2a587b req-4a3a8618-8d26-4435-ab33-410568639152 service nova] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-46ef6ee4-4fad-4818-b190-17e4cf2a587b req-4a3a8618-8d26-4435-ab33-410568639152 service nova] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-46ef6ee4-4fad-4818-b190-17e4cf2a587b req-4a3a8618-8d26-4435-ab33-410568639152 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] No waiting events found dispatching network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:27 user nova-compute[74241]: WARNING nova.compute.manager [req-46ef6ee4-4fad-4818-b190-17e4cf2a587b req-4a3a8618-8d26-4435-ab33-410568639152 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received unexpected event network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 for instance with vm_state active and task_state None.
Oct 20 11:33:27 user nova-compute[74241]: DEBUG nova.network.neutron [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Successfully created port: 8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:33:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Instance spawned successfully.
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:33:28 user nova-compute[74241]: INFO nova.compute.claims [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Claim successful on node user
Oct 20 11:33:28 user nova-compute[74241]: INFO nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Took 10.50 seconds to spawn the instance on the hypervisor.
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:33:28 user nova-compute[74241]: INFO nova.compute.manager [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Took 12.03 seconds to build instance.
Oct 20 11:33:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bd6ef64a-0313-4a8c-9403-32dc7c0248ab tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.218s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:33:28 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:33:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 20 11:33:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG nova.policy [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc7a643b6dac4d7899775dabdae45a05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb36380f186a45329b824553df3d4802', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-afe23840-6ca9-413a-96c7-be7ced9486a2 req-980b8e53-5886-40be-b3bf-153586a26527 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-afe23840-6ca9-413a-96c7-be7ced9486a2 req-980b8e53-5886-40be-b3bf-153586a26527 service nova] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-afe23840-6ca9-413a-96c7-be7ced9486a2 req-980b8e53-5886-40be-b3bf-153586a26527 service nova] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-afe23840-6ca9-413a-96c7-be7ced9486a2 req-980b8e53-5886-40be-b3bf-153586a26527 service nova] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-afe23840-6ca9-413a-96c7-be7ced9486a2 req-980b8e53-5886-40be-b3bf-153586a26527 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] No waiting events found dispatching network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:29 user nova-compute[74241]: WARNING nova.compute.manager [req-afe23840-6ca9-413a-96c7-be7ced9486a2 req-980b8e53-5886-40be-b3bf-153586a26527 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received unexpected event network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 for instance with vm_state active and task_state None.
Oct 20 11:33:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:33:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Creating image(s)
Oct 20 11:33:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "/opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "/opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "/opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "b2affe9803e597d471e96f8d318cb898a4382207" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "b2affe9803e597d471e96f8d318cb898a4382207" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Successfully created port: f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Successfully updated port: 8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquired lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207.part --force-share --output=json" returned: 0 in 0.259s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.virt.images [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] 5a4f8dbd-af62-4496-b722-68ff8e23ec40 was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207.part /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-8f38d0c8-7dc5-4e54-bbc6-b2ce694cd19d req-3cb18e58-c62e-4baa-b62e-7a15f0d92d73 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received event network-changed-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-8f38d0c8-7dc5-4e54-bbc6-b2ce694cd19d req-3cb18e58-c62e-4baa-b62e-7a15f0d92d73 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Refreshing instance network info cache due to event network-changed-8604e215-a83b-4c89-8bea-f37fcc7683cc. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8f38d0c8-7dc5-4e54-bbc6-b2ce694cd19d req-3cb18e58-c62e-4baa-b62e-7a15f0d92d73 service nova] Acquiring lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207.part /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207.converted" returned: 0 in 0.241s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207.converted --force-share --output=json" returned: 0 in 0.290s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "b2affe9803e597d471e96f8d318cb898a4382207" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.656s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:33:31 user nova-compute[74241]: INFO nova.compute.claims [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Claim successful on node user
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207 --force-share --output=json" returned: 0 in 0.226s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "b2affe9803e597d471e96f8d318cb898a4382207" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "b2affe9803e597d471e96f8d318cb898a4382207" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207 --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207,backing_fmt=raw /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207,backing_fmt=raw /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk 1073741824" returned: 0 in 0.097s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "b2affe9803e597d471e96f8d318cb898a4382207" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Successfully updated port: f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquired lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-03c82e9e-a92b-43d2-bd11-4ff1ea0f8959 req-a76e87fa-b956-4f61-9a25-bb42acc90de5 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received event network-changed-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-03c82e9e-a92b-43d2-bd11-4ff1ea0f8959 req-a76e87fa-b956-4f61-9a25-bb42acc90de5 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Refreshing instance network info cache due to event network-changed-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-03c82e9e-a92b-43d2-bd11-4ff1ea0f8959 req-a76e87fa-b956-4f61-9a25-bb42acc90de5 service nova] Acquiring lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.network.neutron [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updating instance_info_cache with network_info: [{"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Releasing lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Instance network_info: |[{"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8f38d0c8-7dc5-4e54-bbc6-b2ce694cd19d req-3cb18e58-c62e-4baa-b62e-7a15f0d92d73 service nova] Acquired lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-8f38d0c8-7dc5-4e54-bbc6-b2ce694cd19d req-3cb18e58-c62e-4baa-b62e-7a15f0d92d73 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Refreshing network info cache for port 8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Start _get_guest_xml network_info=[{"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207 --force-share --output=json" returned: 0 in 0.251s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:31 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:31 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2082572523',display_name='tempest-TestVolumeSwap-server-2082572523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2082572523',id=5,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMW9xBWk87YorZXs2mmeENWsFyTAQUMAccB3btT++i8j7X1MiTqzOi8YmrTxVeDk6nZ6O9fUI6zg8jchTr3DQHDbyCe7nhH5zyqzDrMFkcWXiZG/qyo4j84HplPGEz2dA==',key_name='tempest-keypair-528041587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846710235ea147a09c582fe0709848e9',ramdisk_id='',reservation_id='r-u6hpwyvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1188959597',owner_user_name='tempest-TestVolumeSwap-1188959597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ab4dcd0a5c44f1a3cf8f56918dba0b',uuid=d77d035b-ec54-4c5e-8dd6-55e5297b02fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Converting VIF {"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a8:80,bridge_name='br-int',has_traffic_filtering=True,id=8604e215-a83b-4c89-8bea-f37fcc7683cc,network=Network(efd33a9d-b3fe-4345-8299-83f4765626a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8604e215-a8') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lazy-loading 'pci_devices' on Instance uuid d77d035b-ec54-4c5e-8dd6-55e5297b02fb {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:33:31 user nova-compute[74241]:   <uuid>d77d035b-ec54-4c5e-8dd6-55e5297b02fb</uuid>
Oct 20 11:33:31 user nova-compute[74241]:   <name>instance-00000005</name>
Oct 20 11:33:31 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:33:31 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:33:31 user nova-compute[74241]:   <metadata>
Oct 20 11:33:31 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:33:31 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:33:31 user nova-compute[74241]:       <nova:name>tempest-TestVolumeSwap-server-2082572523</nova:name>
Oct 20 11:33:31 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:33:31</nova:creationTime>
Oct 20 11:33:31 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:33:31 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:33:31 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:33:31 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:33:31 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:33:31 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:33:31 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:33:31 user nova-compute[74241]:       <nova:owner>
Oct 20 11:33:31 user nova-compute[74241]:         <nova:user uuid="54ab4dcd0a5c44f1a3cf8f56918dba0b">tempest-TestVolumeSwap-1188959597-project-member</nova:user>
Oct 20 11:33:31 user nova-compute[74241]:         <nova:project uuid="846710235ea147a09c582fe0709848e9">tempest-TestVolumeSwap-1188959597</nova:project>
Oct 20 11:33:31 user nova-compute[74241]:       </nova:owner>
Oct 20 11:33:31 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:33:31 user nova-compute[74241]:       <nova:ports>
Oct 20 11:33:31 user nova-compute[74241]:         <nova:port uuid="8604e215-a83b-4c89-8bea-f37fcc7683cc">
Oct 20 11:33:31 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:33:31 user nova-compute[74241]:         </nova:port>
Oct 20 11:33:31 user nova-compute[74241]:       </nova:ports>
Oct 20 11:33:31 user nova-compute[74241]:     </nova:instance>
Oct 20 11:33:31 user nova-compute[74241]:   </metadata>
Oct 20 11:33:31 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:33:31 user nova-compute[74241]:     <system>
Oct 20 11:33:31 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:33:31 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:33:31 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:33:31 user nova-compute[74241]:       <entry name="serial">d77d035b-ec54-4c5e-8dd6-55e5297b02fb</entry>
Oct 20 11:33:31 user nova-compute[74241]:       <entry name="uuid">d77d035b-ec54-4c5e-8dd6-55e5297b02fb</entry>
Oct 20 11:33:31 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:33:31 user nova-compute[74241]:     </system>
Oct 20 11:33:31 user nova-compute[74241]:   </sysinfo>
Oct 20 11:33:31 user nova-compute[74241]:   <os>
Oct 20 11:33:31 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:33:31 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:33:31 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:33:31 user nova-compute[74241]:   </os>
Oct 20 11:33:31 user nova-compute[74241]:   <features>
Oct 20 11:33:31 user nova-compute[74241]:     <acpi/>
Oct 20 11:33:31 user nova-compute[74241]:     <apic/>
Oct 20 11:33:31 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:33:31 user nova-compute[74241]:   </features>
Oct 20 11:33:31 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:33:31 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:33:31 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:33:31 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:33:31 user nova-compute[74241]:   </clock>
Oct 20 11:33:31 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:33:31 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:33:31 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:33:31 user nova-compute[74241]:   </cpu>
Oct 20 11:33:31 user nova-compute[74241]:   <devices>
Oct 20 11:33:31 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:33:31 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:33:31 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk"/>
Oct 20 11:33:31 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:33:31 user nova-compute[74241]:     </disk>
Oct 20 11:33:31 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:33:31 user nova-compute[74241]:       <mac address="fa:16:3e:34:a8:80"/>
Oct 20 11:33:31 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:31 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:33:31 user nova-compute[74241]:       <target dev="tap8604e215-a8"/>
Oct 20 11:33:31 user nova-compute[74241]:     </interface>
Oct 20 11:33:31 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:33:31 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/console.log" append="off"/>
Oct 20 11:33:31 user nova-compute[74241]:     </serial>
Oct 20 11:33:31 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:33:31 user nova-compute[74241]:     <video>
Oct 20 11:33:31 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:31 user nova-compute[74241]:     </video>
Oct 20 11:33:31 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:33:31 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:33:31 user nova-compute[74241]:     </rng>
Oct 20 11:33:31 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:33:31 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:33:31 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:33:31 user nova-compute[74241]:     </memballoon>
Oct 20 11:33:31 user nova-compute[74241]:   </devices>
Oct 20 11:33:31 user nova-compute[74241]: </domain>
Oct 20 11:33:31 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2082572523',display_name='tempest-TestVolumeSwap-server-2082572523',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2082572523',id=5,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMW9xBWk87YorZXs2mmeENWsFyTAQUMAccB3btT++i8j7X1MiTqzOi8YmrTxVeDk6nZ6O9fUI6zg8jchTr3DQHDbyCe7nhH5zyqzDrMFkcWXiZG/qyo4j84HplPGEz2dA==',key_name='tempest-keypair-528041587',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846710235ea147a09c582fe0709848e9',ramdisk_id='',reservation_id='r-u6hpwyvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1188959597',owner_user_name='tempest-TestVolumeSwap-1188959597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ab4dcd0a5c44f1a3cf8f56918dba0b',uuid=d77d035b-ec54-4c5e-8dd6-55e5297b02fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Converting VIF {"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:a8:80,bridge_name='br-int',has_traffic_filtering=True,id=8604e215-a83b-4c89-8bea-f37fcc7683cc,network=Network(efd33a9d-b3fe-4345-8299-83f4765626a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8604e215-a8') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG os_vif [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a8:80,bridge_name='br-int',has_traffic_filtering=True,id=8604e215-a83b-4c89-8bea-f37fcc7683cc,network=Network(efd33a9d-b3fe-4345-8299-83f4765626a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8604e215-a8') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '409679d4-2edf-56ad-8cca-accdb2622d55', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Cannot resize image /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Ensure instance console log exists: /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8604e215-a8, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8604e215-a8, col_values=(('qos', UUID('e7fd71a2-1d84-4172-aeca-08751ca3f237')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8604e215-a8, col_values=(('external_ids', {'iface-id': '8604e215-a83b-4c89-8bea-f37fcc7683cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:a8:80', 'vm-uuid': 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: INFO os_vif [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:a8:80,bridge_name='br-int',has_traffic_filtering=True,id=8604e215-a83b-4c89-8bea-f37fcc7683cc,network=Network(efd33a9d-b3fe-4345-8299-83f4765626a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8604e215-a8')
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.993s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] No VIF found with MAC fa:16:3e:34:a8:80, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:33:32 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Updating instance_info_cache with network_info: [{"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Releasing lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Instance network_info: |[{"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-03c82e9e-a92b-43d2-bd11-4ff1ea0f8959 req-a76e87fa-b956-4f61-9a25-bb42acc90de5 service nova] Acquired lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-03c82e9e-a92b-43d2-bd11-4ff1ea0f8959 req-a76e87fa-b956-4f61-9a25-bb42acc90de5 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Refreshing network info cache for port f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Start _get_guest_xml network_info=[{"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:33:17Z,direct_url=<?>,disk_format='qcow2',id=5a4f8dbd-af62-4496-b722-68ff8e23ec40,min_disk=0,min_ram=0,name='',owner='2bdb1a40a1714ae09febc3eb76127ef4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:33:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'device_name': '/dev/sda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'scsi', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '5a4f8dbd-af62-4496-b722-68ff8e23ec40'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:33:32 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:32 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.policy [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16555d6cef90422db4c851511083a34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb28511a3ff4f30bffdd7c8aa870c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:33:17Z,direct_url=<?>,disk_format='qcow2',id=5a4f8dbd-af62-4496-b722-68ff8e23ec40,min_disk=0,min_ram=0,name='',owner='2bdb1a40a1714ae09febc3eb76127ef4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:33:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-456613760',display_name='tempest-AttachSCSIVolumeTestJSON-server-456613760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-456613760',id=6,image_ref='5a4f8dbd-af62-4496-b722-68ff8e23ec40',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX+31qGde1ohA+BDv3a3O7nbNRN/SypZiXsuCkQRb0HnqSD+gtbODzj/4kUcL70xM946MYFHACGylKMm0H2f75w5P6ilp9uv6hYL6Ux4LTyqGzWRE6Elpprp1b2afFNKg==',key_name='tempest-keypair-1211747481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb36380f186a45329b824553df3d4802',ramdisk_id='',reservation_id='r-jcdzb6z2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5a4f8dbd-af62-4496-b722-68ff8e23ec40',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1995034066',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1995034066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc7a643b6dac4d7899775dabdae45a05',uuid=d128bb7d-42b2-4d1a-94c0-de749ec2235c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Converting VIF {"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5b:82,bridge_name='br-int',has_traffic_filtering=True,id=f0ddf1fc-cdd1-44a5-96a6-afc986e60c34,network=Network(867c06f4-3caf-45bc-982a-06123e68f852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ddf1fc-cd') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lazy-loading 'pci_devices' on Instance uuid d128bb7d-42b2-4d1a-94c0-de749ec2235c {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-8f38d0c8-7dc5-4e54-bbc6-b2ce694cd19d req-3cb18e58-c62e-4baa-b62e-7a15f0d92d73 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updated VIF entry in instance network info cache for port 8604e215-a83b-4c89-8bea-f37fcc7683cc. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-8f38d0c8-7dc5-4e54-bbc6-b2ce694cd19d req-3cb18e58-c62e-4baa-b62e-7a15f0d92d73 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updating instance_info_cache with network_info: [{"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:33:32 user nova-compute[74241]:   <uuid>d128bb7d-42b2-4d1a-94c0-de749ec2235c</uuid>
Oct 20 11:33:32 user nova-compute[74241]:   <name>instance-00000006</name>
Oct 20 11:33:32 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:33:32 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:33:32 user nova-compute[74241]:   <metadata>
Oct 20 11:33:32 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:33:32 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:33:32 user nova-compute[74241]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-456613760</nova:name>
Oct 20 11:33:32 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:33:32</nova:creationTime>
Oct 20 11:33:32 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:33:32 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:33:32 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:33:32 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:33:32 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:33:32 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:33:32 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:33:32 user nova-compute[74241]:       <nova:owner>
Oct 20 11:33:32 user nova-compute[74241]:         <nova:user uuid="fc7a643b6dac4d7899775dabdae45a05">tempest-AttachSCSIVolumeTestJSON-1995034066-project-member</nova:user>
Oct 20 11:33:32 user nova-compute[74241]:         <nova:project uuid="cb36380f186a45329b824553df3d4802">tempest-AttachSCSIVolumeTestJSON-1995034066</nova:project>
Oct 20 11:33:32 user nova-compute[74241]:       </nova:owner>
Oct 20 11:33:32 user nova-compute[74241]:       <nova:root type="image" uuid="5a4f8dbd-af62-4496-b722-68ff8e23ec40"/>
Oct 20 11:33:32 user nova-compute[74241]:       <nova:ports>
Oct 20 11:33:32 user nova-compute[74241]:         <nova:port uuid="f0ddf1fc-cdd1-44a5-96a6-afc986e60c34">
Oct 20 11:33:32 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 11:33:32 user nova-compute[74241]:         </nova:port>
Oct 20 11:33:32 user nova-compute[74241]:       </nova:ports>
Oct 20 11:33:32 user nova-compute[74241]:     </nova:instance>
Oct 20 11:33:32 user nova-compute[74241]:   </metadata>
Oct 20 11:33:32 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:33:32 user nova-compute[74241]:     <system>
Oct 20 11:33:32 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:33:32 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:33:32 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:33:32 user nova-compute[74241]:       <entry name="serial">d128bb7d-42b2-4d1a-94c0-de749ec2235c</entry>
Oct 20 11:33:32 user nova-compute[74241]:       <entry name="uuid">d128bb7d-42b2-4d1a-94c0-de749ec2235c</entry>
Oct 20 11:33:32 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:33:32 user nova-compute[74241]:     </system>
Oct 20 11:33:32 user nova-compute[74241]:   </sysinfo>
Oct 20 11:33:32 user nova-compute[74241]:   <os>
Oct 20 11:33:32 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:33:32 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:33:32 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:33:32 user nova-compute[74241]:   </os>
Oct 20 11:33:32 user nova-compute[74241]:   <features>
Oct 20 11:33:32 user nova-compute[74241]:     <acpi/>
Oct 20 11:33:32 user nova-compute[74241]:     <apic/>
Oct 20 11:33:32 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:33:32 user nova-compute[74241]:   </features>
Oct 20 11:33:32 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:33:32 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:33:32 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:33:32 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:33:32 user nova-compute[74241]:   </clock>
Oct 20 11:33:32 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:33:32 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:33:32 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:33:32 user nova-compute[74241]:   </cpu>
Oct 20 11:33:32 user nova-compute[74241]:   <devices>
Oct 20 11:33:32 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:33:32 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:33:32 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk"/>
Oct 20 11:33:32 user nova-compute[74241]:       <target dev="sda" bus="scsi"/>
Oct 20 11:33:32 user nova-compute[74241]:       <address type="drive" controller="0" unit="0"/>
Oct 20 11:33:32 user nova-compute[74241]:     </disk>
Oct 20 11:33:32 user nova-compute[74241]:     <disk type="file" device="cdrom">
Oct 20 11:33:32 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 11:33:32 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk.config"/>
Oct 20 11:33:32 user nova-compute[74241]:       <target dev="sdb" bus="scsi"/>
Oct 20 11:33:32 user nova-compute[74241]:       <address type="drive" controller="0" unit="1"/>
Oct 20 11:33:32 user nova-compute[74241]:     </disk>
Oct 20 11:33:32 user nova-compute[74241]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 20 11:33:32 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:33:32 user nova-compute[74241]:       <mac address="fa:16:3e:6e:5b:82"/>
Oct 20 11:33:32 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:32 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:33:32 user nova-compute[74241]:       <target dev="tapf0ddf1fc-cd"/>
Oct 20 11:33:32 user nova-compute[74241]:     </interface>
Oct 20 11:33:32 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:33:32 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/console.log" append="off"/>
Oct 20 11:33:32 user nova-compute[74241]:     </serial>
Oct 20 11:33:32 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:33:32 user nova-compute[74241]:     <video>
Oct 20 11:33:32 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:32 user nova-compute[74241]:     </video>
Oct 20 11:33:32 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:33:32 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:33:32 user nova-compute[74241]:     </rng>
Oct 20 11:33:32 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:33:32 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:33:32 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:33:32 user nova-compute[74241]:     </memballoon>
Oct 20 11:33:32 user nova-compute[74241]:   </devices>
Oct 20 11:33:32 user nova-compute[74241]: </domain>
Oct 20 11:33:32 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-456613760',display_name='tempest-AttachSCSIVolumeTestJSON-server-456613760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-456613760',id=6,image_ref='5a4f8dbd-af62-4496-b722-68ff8e23ec40',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX+31qGde1ohA+BDv3a3O7nbNRN/SypZiXsuCkQRb0HnqSD+gtbODzj/4kUcL70xM946MYFHACGylKMm0H2f75w5P6ilp9uv6hYL6Ux4LTyqGzWRE6Elpprp1b2afFNKg==',key_name='tempest-keypair-1211747481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb36380f186a45329b824553df3d4802',ramdisk_id='',reservation_id='r-jcdzb6z2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5a4f8dbd-af62-4496-b722-68ff8e23ec40',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1995034066',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1995034066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc7a643b6dac4d7899775dabdae45a05',uuid=d128bb7d-42b2-4d1a-94c0-de749ec2235c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Converting VIF {"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5b:82,bridge_name='br-int',has_traffic_filtering=True,id=f0ddf1fc-cdd1-44a5-96a6-afc986e60c34,network=Network(867c06f4-3caf-45bc-982a-06123e68f852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ddf1fc-cd') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG os_vif [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5b:82,bridge_name='br-int',has_traffic_filtering=True,id=f0ddf1fc-cdd1-44a5-96a6-afc986e60c34,network=Network(867c06f4-3caf-45bc-982a-06123e68f852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ddf1fc-cd') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '35e4f3eb-621f-5fb8-8445-486ec91abfd5', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8f38d0c8-7dc5-4e54-bbc6-b2ce694cd19d req-3cb18e58-c62e-4baa-b62e-7a15f0d92d73 service nova] Releasing lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:33:32 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Creating image(s)
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0ddf1fc-cd, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0ddf1fc-cd, col_values=(('qos', UUID('d59617a0-8644-422e-85b4-b216cb75309f')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0ddf1fc-cd, col_values=(('external_ids', {'iface-id': 'f0ddf1fc-cdd1-44a5-96a6-afc986e60c34', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:5b:82', 'vm-uuid': 'd128bb7d-42b2-4d1a-94c0-de749ec2235c'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:32 user nova-compute[74241]: INFO os_vif [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:5b:82,bridge_name='br-int',has_traffic_filtering=True,id=f0ddf1fc-cdd1-44a5-96a6-afc986e60c34,network=Network(867c06f4-3caf-45bc-982a-06123e68f852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ddf1fc-cd')
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] No BDM found with device name sda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] No VIF found with MAC fa:16:3e:6e:5b:82, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:33:32 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Using config drive
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.250s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-03c82e9e-a92b-43d2-bd11-4ff1ea0f8959 req-a76e87fa-b956-4f61-9a25-bb42acc90de5 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Updated VIF entry in instance network info cache for port f0ddf1fc-cdd1-44a5-96a6-afc986e60c34. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:33:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-03c82e9e-a92b-43d2-bd11-4ff1ea0f8959 req-a76e87fa-b956-4f61-9a25-bb42acc90de5 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Updating instance_info_cache with network_info: [{"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-03c82e9e-a92b-43d2-bd11-4ff1ea0f8959 req-a76e87fa-b956-4f61-9a25-bb42acc90de5 service nova] Releasing lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.249s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk 1073741824" returned: 0 in 0.083s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:33 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Creating config drive at /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk.config
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp12rat3yt {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Successfully created port: 88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp12rat3yt" returned: 0 in 0.095s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.294s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Cannot resize image /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Ensure instance console log exists: /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-688acf64-43e3-43b2-ae6d-7554e8b3419a req-83c9bf15-a988-4e2d-91e7-8d46c186e2fc service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received event network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-688acf64-43e3-43b2-ae6d-7554e8b3419a req-83c9bf15-a988-4e2d-91e7-8d46c186e2fc service nova] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-688acf64-43e3-43b2-ae6d-7554e8b3419a req-83c9bf15-a988-4e2d-91e7-8d46c186e2fc service nova] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-688acf64-43e3-43b2-ae6d-7554e8b3419a req-83c9bf15-a988-4e2d-91e7-8d46c186e2fc service nova] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-688acf64-43e3-43b2-ae6d-7554e8b3419a req-83c9bf15-a988-4e2d-91e7-8d46c186e2fc service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] No waiting events found dispatching network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:34 user nova-compute[74241]: WARNING nova.compute.manager [req-688acf64-43e3-43b2-ae6d-7554e8b3419a req-83c9bf15-a988-4e2d-91e7-8d46c186e2fc service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received unexpected event network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc for instance with vm_state building and task_state spawning.
Oct 20 11:33:34 user nova-compute[74241]: DEBUG nova.network.neutron [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Successfully updated port: 88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquired lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG nova.network.neutron [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-03373f3c-e22d-4be0-a1da-8100e440cf2f req-cc8e3fa9-fe17-4179-8342-239c784860ce service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-changed-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-03373f3c-e22d-4be0-a1da-8100e440cf2f req-cc8e3fa9-fe17-4179-8342-239c784860ce service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Refreshing instance network info cache due to event network-changed-88fde83f-c742-460e-8d1a-78982cbb685e. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-03373f3c-e22d-4be0-a1da-8100e440cf2f req-cc8e3fa9-fe17-4179-8342-239c784860ce service nova] Acquiring lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG nova.network.neutron [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating instance_info_cache with network_info: [{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Releasing lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Instance network_info: |[{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-03373f3c-e22d-4be0-a1da-8100e440cf2f req-cc8e3fa9-fe17-4179-8342-239c784860ce service nova] Acquired lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.network.neutron [req-03373f3c-e22d-4be0-a1da-8100e440cf2f req-cc8e3fa9-fe17-4179-8342-239c784860ce service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Refreshing network info cache for port 88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Start _get_guest_xml network_info=[{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:33:35 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:35 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converting VIF {"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:83,bridge_name='br-int',has_traffic_filtering=True,id=88fde83f-c742-460e-8d1a-78982cbb685e,network=Network(5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88fde83f-c7') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.objects.instance [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lazy-loading 'pci_devices' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:33:35 user nova-compute[74241]:   <uuid>726a7f29-03b0-489f-a77d-9a77e5c4a546</uuid>
Oct 20 11:33:35 user nova-compute[74241]:   <name>instance-00000007</name>
Oct 20 11:33:35 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:33:35 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:33:35 user nova-compute[74241]:   <metadata>
Oct 20 11:33:35 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:33:35 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:33:35 user nova-compute[74241]:       <nova:name>tempest-device-tagging-server-1761481514</nova:name>
Oct 20 11:33:35 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:33:35</nova:creationTime>
Oct 20 11:33:35 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:33:35 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:33:35 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:33:35 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:33:35 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:33:35 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:33:35 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:33:35 user nova-compute[74241]:       <nova:owner>
Oct 20 11:33:35 user nova-compute[74241]:         <nova:user uuid="16555d6cef90422db4c851511083a34f">tempest-TaggedAttachmentsTest-20080626-project-member</nova:user>
Oct 20 11:33:35 user nova-compute[74241]:         <nova:project uuid="ccb28511a3ff4f30bffdd7c8aa870c39">tempest-TaggedAttachmentsTest-20080626</nova:project>
Oct 20 11:33:35 user nova-compute[74241]:       </nova:owner>
Oct 20 11:33:35 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:33:35 user nova-compute[74241]:       <nova:ports>
Oct 20 11:33:35 user nova-compute[74241]:         <nova:port uuid="88fde83f-c742-460e-8d1a-78982cbb685e">
Oct 20 11:33:35 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:33:35 user nova-compute[74241]:         </nova:port>
Oct 20 11:33:35 user nova-compute[74241]:       </nova:ports>
Oct 20 11:33:35 user nova-compute[74241]:     </nova:instance>
Oct 20 11:33:35 user nova-compute[74241]:   </metadata>
Oct 20 11:33:35 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:33:35 user nova-compute[74241]:     <system>
Oct 20 11:33:35 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:33:35 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:33:35 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:33:35 user nova-compute[74241]:       <entry name="serial">726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:33:35 user nova-compute[74241]:       <entry name="uuid">726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:33:35 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:33:35 user nova-compute[74241]:     </system>
Oct 20 11:33:35 user nova-compute[74241]:   </sysinfo>
Oct 20 11:33:35 user nova-compute[74241]:   <os>
Oct 20 11:33:35 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:33:35 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:33:35 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:33:35 user nova-compute[74241]:   </os>
Oct 20 11:33:35 user nova-compute[74241]:   <features>
Oct 20 11:33:35 user nova-compute[74241]:     <acpi/>
Oct 20 11:33:35 user nova-compute[74241]:     <apic/>
Oct 20 11:33:35 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:33:35 user nova-compute[74241]:   </features>
Oct 20 11:33:35 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:33:35 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:33:35 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:33:35 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:33:35 user nova-compute[74241]:   </clock>
Oct 20 11:33:35 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:33:35 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:33:35 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:33:35 user nova-compute[74241]:   </cpu>
Oct 20 11:33:35 user nova-compute[74241]:   <devices>
Oct 20 11:33:35 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:33:35 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:33:35 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk"/>
Oct 20 11:33:35 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:33:35 user nova-compute[74241]:     </disk>
Oct 20 11:33:35 user nova-compute[74241]:     <disk type="file" device="cdrom">
Oct 20 11:33:35 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 11:33:35 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.config"/>
Oct 20 11:33:35 user nova-compute[74241]:       <target dev="hda" bus="ide"/>
Oct 20 11:33:35 user nova-compute[74241]:     </disk>
Oct 20 11:33:35 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:33:35 user nova-compute[74241]:       <mac address="fa:16:3e:ae:a1:83"/>
Oct 20 11:33:35 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:35 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:33:35 user nova-compute[74241]:       <target dev="tap88fde83f-c7"/>
Oct 20 11:33:35 user nova-compute[74241]:     </interface>
Oct 20 11:33:35 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:33:35 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log" append="off"/>
Oct 20 11:33:35 user nova-compute[74241]:     </serial>
Oct 20 11:33:35 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:33:35 user nova-compute[74241]:     <video>
Oct 20 11:33:35 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:35 user nova-compute[74241]:     </video>
Oct 20 11:33:35 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:33:35 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:33:35 user nova-compute[74241]:     </rng>
Oct 20 11:33:35 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:33:35 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:33:35 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:33:35 user nova-compute[74241]:     </memballoon>
Oct 20 11:33:35 user nova-compute[74241]:   </devices>
Oct 20 11:33:35 user nova-compute[74241]: </domain>
Oct 20 11:33:35 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converting VIF {"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:83,bridge_name='br-int',has_traffic_filtering=True,id=88fde83f-c742-460e-8d1a-78982cbb685e,network=Network(5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88fde83f-c7') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG os_vif [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:83,bridge_name='br-int',has_traffic_filtering=True,id=88fde83f-c742-460e-8d1a-78982cbb685e,network=Network(5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88fde83f-c7') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ef9c634-8242-5cf8-af70-8041ab66b7fb', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88fde83f-c7, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88fde83f-c7, col_values=(('qos', UUID('0776f2b0-360b-4723-863a-2bc7c9211bfe')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88fde83f-c7, col_values=(('external_ids', {'iface-id': '88fde83f-c742-460e-8d1a-78982cbb685e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:a1:83', 'vm-uuid': '726a7f29-03b0-489f-a77d-9a77e5c4a546'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: INFO os_vif [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:a1:83,bridge_name='br-int',has_traffic_filtering=True,id=88fde83f-c742-460e-8d1a-78982cbb685e,network=Network(5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88fde83f-c7')
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No BDM found with device name hda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No VIF found with MAC fa:16:3e:ae:a1:83, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:33:35 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Using config drive
Oct 20 11:33:35 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Creating config drive at /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.config
Oct 20 11:33:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx1v942_s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpx1v942_s" returned: 0 in 0.076s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG nova.network.neutron [req-03373f3c-e22d-4be0-a1da-8100e440cf2f req-cc8e3fa9-fe17-4179-8342-239c784860ce service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updated VIF entry in instance network info cache for port 88fde83f-c742-460e-8d1a-78982cbb685e. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG nova.network.neutron [req-03373f3c-e22d-4be0-a1da-8100e440cf2f req-cc8e3fa9-fe17-4179-8342-239c784860ce service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating instance_info_cache with network_info: [{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-03373f3c-e22d-4be0-a1da-8100e440cf2f req-cc8e3fa9-fe17-4179-8342-239c784860ce service nova] Releasing lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-bc78548f-1c8d-4230-b145-a82a3f698083 req-bcc1b05c-02d2-48c8-ae51-e472a34171c2 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received event network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc78548f-1c8d-4230-b145-a82a3f698083 req-bcc1b05c-02d2-48c8-ae51-e472a34171c2 service nova] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc78548f-1c8d-4230-b145-a82a3f698083 req-bcc1b05c-02d2-48c8-ae51-e472a34171c2 service nova] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc78548f-1c8d-4230-b145-a82a3f698083 req-bcc1b05c-02d2-48c8-ae51-e472a34171c2 service nova] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-bc78548f-1c8d-4230-b145-a82a3f698083 req-bcc1b05c-02d2-48c8-ae51-e472a34171c2 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] No waiting events found dispatching network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:36 user nova-compute[74241]: WARNING nova.compute.manager [req-bc78548f-1c8d-4230-b145-a82a3f698083 req-bcc1b05c-02d2-48c8-ae51-e472a34171c2 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received unexpected event network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc for instance with vm_state building and task_state spawning.
Oct 20 11:33:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-5ec91366-4a37-48c6-8644-056e4c050f79 req-20f77a69-3775-4819-9663-44bd4d2ab9a5 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received event network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ec91366-4a37-48c6-8644-056e4c050f79 req-20f77a69-3775-4819-9663-44bd4d2ab9a5 service nova] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ec91366-4a37-48c6-8644-056e4c050f79 req-20f77a69-3775-4819-9663-44bd4d2ab9a5 service nova] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ec91366-4a37-48c6-8644-056e4c050f79 req-20f77a69-3775-4819-9663-44bd4d2ab9a5 service nova] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-5ec91366-4a37-48c6-8644-056e4c050f79 req-20f77a69-3775-4819-9663-44bd4d2ab9a5 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] No waiting events found dispatching network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:38 user nova-compute[74241]: WARNING nova.compute.manager [req-5ec91366-4a37-48c6-8644-056e4c050f79 req-20f77a69-3775-4819-9663-44bd4d2ab9a5 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received unexpected event network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a for instance with vm_state active and task_state None.
Oct 20 11:33:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:33:38 user nova-compute[74241]: INFO nova.compute.claims [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Claim successful on node user
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:33:38 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Instance spawned successfully.
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:38 user nova-compute[74241]: INFO nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Took 13.89 seconds to spawn the instance on the hypervisor.
Oct 20 11:33:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:33:39 user nova-compute[74241]: INFO nova.compute.manager [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Took 15.09 seconds to build instance.
Oct 20 11:33:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7088aea9-807f-4106-ac1a-ae50f8c6066f tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.266s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:33:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.policy [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ceec2bec1614ffb8faa22b5fa31a300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2389f277868946dc9f4f5f4d82057534', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:33:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Creating image(s)
Oct 20 11:33:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "/opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "/opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Instance spawned successfully.
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:40 user nova-compute[74241]: INFO nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Took 10.77 seconds to spawn the instance on the hypervisor.
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.216s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk 1073741824" returned: 0 in 0.067s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:40 user nova-compute[74241]: INFO nova.compute.manager [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Took 12.32 seconds to build instance.
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received event network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] No waiting events found dispatching network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:40 user nova-compute[74241]: WARNING nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received unexpected event network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a for instance with vm_state active and task_state None.
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:40 user nova-compute[74241]: WARNING nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state active and task_state None.
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:40 user nova-compute[74241]: WARNING nova.compute.manager [req-8694919f-fd1e-415f-965b-b32e1c6a019e req-9f0304ac-cfdd-4588-b19a-3438efed0871 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state active and task_state None.
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f40880bf-08b2-47ae-9216-64a229fc82ad tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.553s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:33:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Instance spawned successfully.
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.305s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:40 user nova-compute[74241]: INFO nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Took 8.21 seconds to spawn the instance on the hypervisor.
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Successfully created port: 2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Cannot resize image /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Ensure instance console log exists: /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:40 user nova-compute[74241]: INFO nova.compute.manager [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Took 9.79 seconds to build instance.
Oct 20 11:33:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-577d0e34-cb89-4ffe-8382-e604ea62473f tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.958s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Successfully updated port: 2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquired lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-d3d23042-7f29-41fb-a93a-67ee8fbacd07 req-90fbf62f-b98a-4b08-929a-8cc70512f287 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received event network-changed-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-d3d23042-7f29-41fb-a93a-67ee8fbacd07 req-90fbf62f-b98a-4b08-929a-8cc70512f287 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Refreshing instance network info cache due to event network-changed-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d3d23042-7f29-41fb-a93a-67ee8fbacd07 req-90fbf62f-b98a-4b08-929a-8cc70512f287 service nova] Acquiring lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 11:33:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Updating instance_info_cache with network_info: [{"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Releasing lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Instance network_info: |[{"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d3d23042-7f29-41fb-a93a-67ee8fbacd07 req-90fbf62f-b98a-4b08-929a-8cc70512f287 service nova] Acquired lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-d3d23042-7f29-41fb-a93a-67ee8fbacd07 req-90fbf62f-b98a-4b08-929a-8cc70512f287 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Refreshing network info cache for port 2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Start _get_guest_xml network_info=[{"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:33:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-45059038',display_name='tempest-VolumesAssistedSnapshotsTest-server-45059038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-45059038',id=8,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvwM7RaGshWqAOA17uile1AkXJS8LxWk0Cp0pqxGclZarMCb1acQ6heVUuirVD2y3MHeBxj4a8zHrIG6xN7IkKmaO4w+P//yVJ3DozZynuAlQgFiLqBZI5mjNc+h8TkVg==',key_name='tempest-keypair-1647619543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2389f277868946dc9f4f5f4d82057534',ramdisk_id='',reservation_id='r-chvlof1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2031640903',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2031640903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ceec2bec1614ffb8faa22b5fa31a300',uuid=9f326446-5aa8-47f0-bc97-0f2c9664319f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Converting VIF {"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:41:14,bridge_name='br-int',has_traffic_filtering=True,id=2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3,network=Network(904df803-d42a-44a6-9e39-df778151fbd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2248f184-5e') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f326446-5aa8-47f0-bc97-0f2c9664319f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:33:42 user nova-compute[74241]:   <uuid>9f326446-5aa8-47f0-bc97-0f2c9664319f</uuid>
Oct 20 11:33:42 user nova-compute[74241]:   <name>instance-00000008</name>
Oct 20 11:33:42 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:33:42 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:33:42 user nova-compute[74241]:   <metadata>
Oct 20 11:33:42 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:33:42 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:33:42 user nova-compute[74241]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-45059038</nova:name>
Oct 20 11:33:42 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:33:42</nova:creationTime>
Oct 20 11:33:42 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:33:42 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:33:42 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:33:42 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:33:42 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:33:42 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:33:42 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:33:42 user nova-compute[74241]:       <nova:owner>
Oct 20 11:33:42 user nova-compute[74241]:         <nova:user uuid="0ceec2bec1614ffb8faa22b5fa31a300">tempest-VolumesAssistedSnapshotsTest-2031640903-project-member</nova:user>
Oct 20 11:33:42 user nova-compute[74241]:         <nova:project uuid="2389f277868946dc9f4f5f4d82057534">tempest-VolumesAssistedSnapshotsTest-2031640903</nova:project>
Oct 20 11:33:42 user nova-compute[74241]:       </nova:owner>
Oct 20 11:33:42 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:33:42 user nova-compute[74241]:       <nova:ports>
Oct 20 11:33:42 user nova-compute[74241]:         <nova:port uuid="2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3">
Oct 20 11:33:42 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:33:42 user nova-compute[74241]:         </nova:port>
Oct 20 11:33:42 user nova-compute[74241]:       </nova:ports>
Oct 20 11:33:42 user nova-compute[74241]:     </nova:instance>
Oct 20 11:33:42 user nova-compute[74241]:   </metadata>
Oct 20 11:33:42 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:33:42 user nova-compute[74241]:     <system>
Oct 20 11:33:42 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:33:42 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:33:42 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:33:42 user nova-compute[74241]:       <entry name="serial">9f326446-5aa8-47f0-bc97-0f2c9664319f</entry>
Oct 20 11:33:42 user nova-compute[74241]:       <entry name="uuid">9f326446-5aa8-47f0-bc97-0f2c9664319f</entry>
Oct 20 11:33:42 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:33:42 user nova-compute[74241]:     </system>
Oct 20 11:33:42 user nova-compute[74241]:   </sysinfo>
Oct 20 11:33:42 user nova-compute[74241]:   <os>
Oct 20 11:33:42 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:33:42 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:33:42 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:33:42 user nova-compute[74241]:   </os>
Oct 20 11:33:42 user nova-compute[74241]:   <features>
Oct 20 11:33:42 user nova-compute[74241]:     <acpi/>
Oct 20 11:33:42 user nova-compute[74241]:     <apic/>
Oct 20 11:33:42 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:33:42 user nova-compute[74241]:   </features>
Oct 20 11:33:42 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:33:42 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:33:42 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:33:42 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:33:42 user nova-compute[74241]:   </clock>
Oct 20 11:33:42 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:33:42 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:33:42 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:33:42 user nova-compute[74241]:   </cpu>
Oct 20 11:33:42 user nova-compute[74241]:   <devices>
Oct 20 11:33:42 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:33:42 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:33:42 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk"/>
Oct 20 11:33:42 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:33:42 user nova-compute[74241]:     </disk>
Oct 20 11:33:42 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:33:42 user nova-compute[74241]:       <mac address="fa:16:3e:9a:41:14"/>
Oct 20 11:33:42 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:42 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:33:42 user nova-compute[74241]:       <target dev="tap2248f184-5e"/>
Oct 20 11:33:42 user nova-compute[74241]:     </interface>
Oct 20 11:33:42 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:33:42 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/console.log" append="off"/>
Oct 20 11:33:42 user nova-compute[74241]:     </serial>
Oct 20 11:33:42 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:33:42 user nova-compute[74241]:     <video>
Oct 20 11:33:42 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:33:42 user nova-compute[74241]:     </video>
Oct 20 11:33:42 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:33:42 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:33:42 user nova-compute[74241]:     </rng>
Oct 20 11:33:42 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:33:42 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:33:42 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:33:42 user nova-compute[74241]:     </memballoon>
Oct 20 11:33:42 user nova-compute[74241]:   </devices>
Oct 20 11:33:42 user nova-compute[74241]: </domain>
Oct 20 11:33:42 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-45059038',display_name='tempest-VolumesAssistedSnapshotsTest-server-45059038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-45059038',id=8,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvwM7RaGshWqAOA17uile1AkXJS8LxWk0Cp0pqxGclZarMCb1acQ6heVUuirVD2y3MHeBxj4a8zHrIG6xN7IkKmaO4w+P//yVJ3DozZynuAlQgFiLqBZI5mjNc+h8TkVg==',key_name='tempest-keypair-1647619543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2389f277868946dc9f4f5f4d82057534',ramdisk_id='',reservation_id='r-chvlof1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2031640903',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2031640903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ceec2bec1614ffb8faa22b5fa31a300',uuid=9f326446-5aa8-47f0-bc97-0f2c9664319f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Converting VIF {"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:41:14,bridge_name='br-int',has_traffic_filtering=True,id=2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3,network=Network(904df803-d42a-44a6-9e39-df778151fbd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2248f184-5e') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG os_vif [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:41:14,bridge_name='br-int',has_traffic_filtering=True,id=2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3,network=Network(904df803-d42a-44a6-9e39-df778151fbd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2248f184-5e') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6bacec0-e236-517c-af9b-1212f5b4b847', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2248f184-5e, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2248f184-5e, col_values=(('qos', UUID('687473e4-c6e2-440f-aa06-4a0a32ecaf44')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2248f184-5e, col_values=(('external_ids', {'iface-id': '2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:41:14', 'vm-uuid': '9f326446-5aa8-47f0-bc97-0f2c9664319f'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:33:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:43 user nova-compute[74241]: INFO os_vif [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:41:14,bridge_name='br-int',has_traffic_filtering=True,id=2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3,network=Network(904df803-d42a-44a6-9e39-df778151fbd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2248f184-5e')
Oct 20 11:33:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] No VIF found with MAC fa:16:3e:9a:41:14, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-d3d23042-7f29-41fb-a93a-67ee8fbacd07 req-90fbf62f-b98a-4b08-929a-8cc70512f287 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Updated VIF entry in instance network info cache for port 2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-d3d23042-7f29-41fb-a93a-67ee8fbacd07 req-90fbf62f-b98a-4b08-929a-8cc70512f287 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Updating instance_info_cache with network_info: [{"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d3d23042-7f29-41fb-a93a-67ee8fbacd07 req-90fbf62f-b98a-4b08-929a-8cc70512f287 service nova] Releasing lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:43 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:33:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-7e31ffbf-b791-46d7-b5c3-61440af62e51 req-7207243b-da7e-4c40-9674-9acac82c7745 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received event network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7e31ffbf-b791-46d7-b5c3-61440af62e51 req-7207243b-da7e-4c40-9674-9acac82c7745 service nova] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7e31ffbf-b791-46d7-b5c3-61440af62e51 req-7207243b-da7e-4c40-9674-9acac82c7745 service nova] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7e31ffbf-b791-46d7-b5c3-61440af62e51 req-7207243b-da7e-4c40-9674-9acac82c7745 service nova] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-7e31ffbf-b791-46d7-b5c3-61440af62e51 req-7207243b-da7e-4c40-9674-9acac82c7745 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] No waiting events found dispatching network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:45 user nova-compute[74241]: WARNING nova.compute.manager [req-7e31ffbf-b791-46d7-b5c3-61440af62e51 req-7207243b-da7e-4c40-9674-9acac82c7745 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received unexpected event network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 for instance with vm_state building and task_state spawning.
Oct 20 11:33:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-52f608bd-1414-4b63-97c7-7b50749f6935 req-bc96f49f-1e3b-4c21-b39b-3681661dad65 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received event network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-52f608bd-1414-4b63-97c7-7b50749f6935 req-bc96f49f-1e3b-4c21-b39b-3681661dad65 service nova] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-52f608bd-1414-4b63-97c7-7b50749f6935 req-bc96f49f-1e3b-4c21-b39b-3681661dad65 service nova] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-52f608bd-1414-4b63-97c7-7b50749f6935 req-bc96f49f-1e3b-4c21-b39b-3681661dad65 service nova] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-52f608bd-1414-4b63-97c7-7b50749f6935 req-bc96f49f-1e3b-4c21-b39b-3681661dad65 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] No waiting events found dispatching network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:47 user nova-compute[74241]: WARNING nova.compute.manager [req-52f608bd-1414-4b63-97c7-7b50749f6935 req-bc96f49f-1e3b-4c21-b39b-3681661dad65 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received unexpected event network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 for instance with vm_state building and task_state spawning.
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:33:47 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Instance spawned successfully.
Oct 20 11:33:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:33:48 user nova-compute[74241]: INFO nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Took 8.44 seconds to spawn the instance on the hypervisor.
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-960bc455-16e2-49d7-9c11-c5fbe014f5bb req-c343d988-dda5-4b39-ab18-92e5a6ad2fc0 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received event network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-960bc455-16e2-49d7-9c11-c5fbe014f5bb req-c343d988-dda5-4b39-ab18-92e5a6ad2fc0 service nova] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-960bc455-16e2-49d7-9c11-c5fbe014f5bb req-c343d988-dda5-4b39-ab18-92e5a6ad2fc0 service nova] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-960bc455-16e2-49d7-9c11-c5fbe014f5bb req-c343d988-dda5-4b39-ab18-92e5a6ad2fc0 service nova] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-960bc455-16e2-49d7-9c11-c5fbe014f5bb req-c343d988-dda5-4b39-ab18-92e5a6ad2fc0 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] No waiting events found dispatching network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:48 user nova-compute[74241]: WARNING nova.compute.manager [req-960bc455-16e2-49d7-9c11-c5fbe014f5bb req-c343d988-dda5-4b39-ab18-92e5a6ad2fc0 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received unexpected event network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 for instance with vm_state active and task_state None.
Oct 20 11:33:48 user nova-compute[74241]: INFO nova.compute.manager [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Took 9.76 seconds to build instance.
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f31c5723-3c00-44ac-b467-7df8b31a67b4 tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.899s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received event network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] No waiting events found dispatching network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:50 user nova-compute[74241]: WARNING nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received unexpected event network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 for instance with vm_state active and task_state None.
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received event network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] No waiting events found dispatching network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:50 user nova-compute[74241]: WARNING nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received unexpected event network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 for instance with vm_state active and task_state None.
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received event network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] No waiting events found dispatching network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:50 user nova-compute[74241]: WARNING nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received unexpected event network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 for instance with vm_state active and task_state None.
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] No waiting events found dispatching network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:50 user nova-compute[74241]: WARNING nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received unexpected event network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e for instance with vm_state active and task_state None.
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] No waiting events found dispatching network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:33:50 user nova-compute[74241]: WARNING nova.compute.manager [req-728c3ec4-91a6-420c-85d2-1fc4a98245fe req-1d397b48-1e95-4825-b295-4b74ed2ff2c8 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received unexpected event network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e for instance with vm_state active and task_state None.
Oct 20 11:33:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:33:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8003MB free_disk=25.75879669189453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:33:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6a1b5fb2-449e-4648-8dc0-276813417b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d128bb7d-42b2-4d1a-94c0-de749ec2235c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9f326446-5aa8-47f0-bc97-0f2c9664319f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:33:51 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:33:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:33:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.300s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 6a1b5fb2-449e-4648-8dc0-276813417b1d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Updating instance_info_cache with network_info: [{"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-6a1b5fb2-449e-4648-8dc0-276813417b1d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:33:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:33:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:33:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:03 user nova-compute[74241]: DEBUG nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:34:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:34:03 user nova-compute[74241]: INFO nova.compute.claims [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Claim successful on node user
Oct 20 11:34:04 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:34:04 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:34:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:34:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:34:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:34:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:34:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:34:04 user nova-compute[74241]: DEBUG nova.policy [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfbfcb932abf47388e416266cd2f1098', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c453ef58eb74b0d9ae83d020931ff83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:34:04 user nova-compute[74241]: INFO nova.virt.block_device [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Booting with volume 2238763d-1ef0-47ab-8b4d-426b0d0d935b at /dev/vda
Oct 20 11:34:04 user nova-compute[74241]: DEBUG os_brick.utils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:34:04 user nova-compute[74241]: INFO oslo.privsep.daemon [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmprysgc42_/privsep.sock']
Oct 20 11:34:04 user sudo[85181]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmprysgc42_/privsep.sock
Oct 20 11:34:04 user sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 11:34:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Successfully created port: f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Successfully updated port: f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquired lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:34:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-26079b39-9586-4114-b39b-23146204f8a1 req-37435839-5c36-48d1-b455-bbea524eb6c6 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-changed-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-26079b39-9586-4114-b39b-23146204f8a1 req-37435839-5c36-48d1-b455-bbea524eb6c6 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Refreshing instance network info cache due to event network-changed-f3ee0369-7aca-4c21-8798-c9158cc47bec. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-26079b39-9586-4114-b39b-23146204f8a1 req-37435839-5c36-48d1-b455-bbea524eb6c6 service nova] Acquiring lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:06 user sudo[85181]: pam_unix(sudo:session): session closed for user root
Oct 20 11:34:06 user nova-compute[74241]: INFO oslo.privsep.daemon [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Spawned new privsep daemon via rootwrap
Oct 20 11:34:06 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 11:34:06 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 11:34:06 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 20 11:34:06 user nova-compute[74241]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85185
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad79c958-68d5-4ce1-b93c-90f89820238c]: (2,) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG nova.network.neutron [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Updating instance_info_cache with network_info: [{"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Releasing lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance network_info: |[{"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-26079b39-9586-4114-b39b-23146204f8a1 req-37435839-5c36-48d1-b455-bbea524eb6c6 service nova] Acquired lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-26079b39-9586-4114-b39b-23146204f8a1 req-37435839-5c36-48d1-b455-bbea524eb6c6 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Refreshing network info cache for port f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b895c5-9bfc-4a32-b300-a5bb9ae26a6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:06 user nova-compute[74241]: WARNING os_brick.initiator.connectors.nvmeof [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce03d76-b4bb-4b43-92f8-a0d2a37f5c56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[16069a24-e09b-433c-a029-d5760e3775e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[27083fdb-22e6-4b49-861a-4e1fed6e6b4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:34:06 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76bb985-44ab-4c86-aa67-cb0f1aca82c5]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG os_brick.utils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] <== get_connector_properties: return (1852ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Updating existing volume attachment record: aa4f6cc8-0a21-4466-a568-f2232027a9e3 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-26079b39-9586-4114-b39b-23146204f8a1 req-37435839-5c36-48d1-b455-bbea524eb6c6 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Updated VIF entry in instance network info cache for port f3ee0369-7aca-4c21-8798-c9158cc47bec. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-26079b39-9586-4114-b39b-23146204f8a1 req-37435839-5c36-48d1-b455-bbea524eb6c6 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Updating instance_info_cache with network_info: [{"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-26079b39-9586-4114-b39b-23146204f8a1 req-37435839-5c36-48d1-b455-bbea524eb6c6 service nova] Releasing lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:34:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:34:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:34:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:34:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:34:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:34:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:34:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:34:34 user nova-compute[74241]: INFO nova.compute.claims [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Claim successful on node user
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:34:35 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:34:35 user nova-compute[74241]: INFO nova.virt.block_device [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Booting with volume 7f25239d-075d-415a-941b-923bad8a992d at /dev/vda
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.policy [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '970b3107655b46128fb25719517d79e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d848adbb2a240649bfd1f2da652cdc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.utils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[771aa976-e2f4-4b5b-8b8f-304de45649f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c4882-3dde-4e06-9e8c-9cc7532adb52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3efaa57-3aaa-49bd-95dd-9580d48734d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cccbef-ceae-42cd-a588-1e23af8018ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:34:35 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[912cd749-3c1f-4fc3-99c7-594b168cf9ec]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.utils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating existing volume attachment record: 9b7e96ab-8bb5-4991-951e-a337bef43917 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:34:35 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Creating image(s)
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Ensure instance console log exists: /opt/stack/data/nova/instances/34e3ad13-abe7-4167-9d8c-474f59397b6e/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Start _get_guest_xml network_info=[{"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'aa4f6cc8-0a21-4466-a568-f2232027a9e3', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34e3ad13-abe7-4167-9d8c-474f59397b6e', 'attached_at': '', 'detached_at': '', 'volume_id': '2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'serial': '2238763d-1ef0-47ab-8b4d-426b0d0d935b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:34:35 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:34:35 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connector [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Factory for ISCSI on None {{(pid=74241) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:34:35 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:34:35 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:34:35 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca62461-0ace-49f0-9df2-c3efe79c52c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:34:35 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:34:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c5cd86-6a0a-4cf4-b644-acaaf20653f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b] added
Oct 20 11:34:36 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec910d7-00ec-494f-ad81-0ef6fd21fd8a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f76b4e5-6a44-4c5d-af36-04c03bb3ed38]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUxbdFNp {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUxbdFNp" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[78653e19-84f7-4223-98b0-c7a36bf1cf02]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RUxbdFNp'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[872d306a-edcd-4477-9184-75c492ed755e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aedbb9-3022-4c93-a171-10b3a831312a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 11:34:36 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 11:34:36 user nova-compute[74241]:  {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:34:36 user nova-compute[74241]: WARNING os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 11:34:36 user nova-compute[74241]: 
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully created port: 3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ae4ce3-1daf-4891-ae69-c5c36c680e0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260]
Oct 20 11:34:36 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260] successful.
Oct 20 11:34:36 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f07925-5812-4c34-a500-1bb2be27db89]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51d916e-e9cf-49b9-b3f3-e3f291c753c4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:34:36 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:34:36 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb33fb74-0a06-49e2-841d-f7d0527a1635]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:34:36 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully created port: 1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully created port: 9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26161633238613333', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161633238613333', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1295570451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1295570451',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaUIsowPmm/MBl/9oF/rCt+woqma1ayrQNEAD67yYMwRXAZ/8sIsCOKQwamQdDx/t/+9n1SuwVQPPyBfK/H1EhTaY9NImQ0KPlZ9u0wdeUyzHwRbNbIGnoy7DD6297w1w==',key_name='tempest-keypair-1421120003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c453ef58eb74b0d9ae83d020931ff83',ramdisk_id='',reservation_id='r-s8k6ynmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1927240912',owner_user_name='tempest-ServerActionsV293TestJSON-1927240912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfbfcb932abf47388e416266cd2f1098',uuid=34e3ad13-abe7-4167-9d8c-474f59397b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converting VIF {"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.objects.instance [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lazy-loading 'pci_devices' on Instance uuid 34e3ad13-abe7-4167-9d8c-474f59397b6e {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:34:37 user nova-compute[74241]:   <uuid>34e3ad13-abe7-4167-9d8c-474f59397b6e</uuid>
Oct 20 11:34:37 user nova-compute[74241]:   <name>instance-00000009</name>
Oct 20 11:34:37 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:34:37 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:34:37 user nova-compute[74241]:   <metadata>
Oct 20 11:34:37 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:34:37 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:34:37 user nova-compute[74241]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1295570451</nova:name>
Oct 20 11:34:37 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:34:35</nova:creationTime>
Oct 20 11:34:37 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:34:37 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:34:37 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:34:37 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:34:37 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:34:37 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:34:37 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:34:37 user nova-compute[74241]:       <nova:owner>
Oct 20 11:34:37 user nova-compute[74241]:         <nova:user uuid="bfbfcb932abf47388e416266cd2f1098">tempest-ServerActionsV293TestJSON-1927240912-project-member</nova:user>
Oct 20 11:34:37 user nova-compute[74241]:         <nova:project uuid="3c453ef58eb74b0d9ae83d020931ff83">tempest-ServerActionsV293TestJSON-1927240912</nova:project>
Oct 20 11:34:37 user nova-compute[74241]:       </nova:owner>
Oct 20 11:34:37 user nova-compute[74241]:       <nova:ports>
Oct 20 11:34:37 user nova-compute[74241]:         <nova:port uuid="f3ee0369-7aca-4c21-8798-c9158cc47bec">
Oct 20 11:34:37 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:34:37 user nova-compute[74241]:         </nova:port>
Oct 20 11:34:37 user nova-compute[74241]:       </nova:ports>
Oct 20 11:34:37 user nova-compute[74241]:     </nova:instance>
Oct 20 11:34:37 user nova-compute[74241]:   </metadata>
Oct 20 11:34:37 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:34:37 user nova-compute[74241]:     <system>
Oct 20 11:34:37 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:34:37 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:34:37 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:34:37 user nova-compute[74241]:       <entry name="serial">34e3ad13-abe7-4167-9d8c-474f59397b6e</entry>
Oct 20 11:34:37 user nova-compute[74241]:       <entry name="uuid">34e3ad13-abe7-4167-9d8c-474f59397b6e</entry>
Oct 20 11:34:37 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:34:37 user nova-compute[74241]:     </system>
Oct 20 11:34:37 user nova-compute[74241]:   </sysinfo>
Oct 20 11:34:37 user nova-compute[74241]:   <os>
Oct 20 11:34:37 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:34:37 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:34:37 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:34:37 user nova-compute[74241]:   </os>
Oct 20 11:34:37 user nova-compute[74241]:   <features>
Oct 20 11:34:37 user nova-compute[74241]:     <acpi/>
Oct 20 11:34:37 user nova-compute[74241]:     <apic/>
Oct 20 11:34:37 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:34:37 user nova-compute[74241]:   </features>
Oct 20 11:34:37 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:34:37 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:34:37 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:34:37 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:34:37 user nova-compute[74241]:   </clock>
Oct 20 11:34:37 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:34:37 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:34:37 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:34:37 user nova-compute[74241]:   </cpu>
Oct 20 11:34:37 user nova-compute[74241]:   <devices>
Oct 20 11:34:37 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:34:37 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:34:37 user nova-compute[74241]:       <source dev="/dev/sdb"/>
Oct 20 11:34:37 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:34:37 user nova-compute[74241]:       <serial>2238763d-1ef0-47ab-8b4d-426b0d0d935b</serial>
Oct 20 11:34:37 user nova-compute[74241]:     </disk>
Oct 20 11:34:37 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:34:37 user nova-compute[74241]:       <mac address="fa:16:3e:68:93:2a"/>
Oct 20 11:34:37 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:34:37 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:34:37 user nova-compute[74241]:       <target dev="tapf3ee0369-7a"/>
Oct 20 11:34:37 user nova-compute[74241]:     </interface>
Oct 20 11:34:37 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:34:37 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/34e3ad13-abe7-4167-9d8c-474f59397b6e/console.log" append="off"/>
Oct 20 11:34:37 user nova-compute[74241]:     </serial>
Oct 20 11:34:37 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:34:37 user nova-compute[74241]:     <video>
Oct 20 11:34:37 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:34:37 user nova-compute[74241]:     </video>
Oct 20 11:34:37 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:34:37 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:34:37 user nova-compute[74241]:     </rng>
Oct 20 11:34:37 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:34:37 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:34:37 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:34:37 user nova-compute[74241]:     </memballoon>
Oct 20 11:34:37 user nova-compute[74241]:   </devices>
Oct 20 11:34:37 user nova-compute[74241]: </domain>
Oct 20 11:34:37 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1295570451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1295570451',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaUIsowPmm/MBl/9oF/rCt+woqma1ayrQNEAD67yYMwRXAZ/8sIsCOKQwamQdDx/t/+9n1SuwVQPPyBfK/H1EhTaY9NImQ0KPlZ9u0wdeUyzHwRbNbIGnoy7DD6297w1w==',key_name='tempest-keypair-1421120003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c453ef58eb74b0d9ae83d020931ff83',ramdisk_id='',reservation_id='r-s8k6ynmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1927240912',owner_user_name='tempest-ServerActionsV293TestJSON-1927240912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfbfcb932abf47388e416266cd2f1098',uuid=34e3ad13-abe7-4167-9d8c-474f59397b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converting VIF {"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG os_vif [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7bfc8a9-de90-5095-83d2-c5526f39c9da', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3ee0369-7a, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3ee0369-7a, col_values=(('qos', UUID('9d956548-9749-403b-baaa-7dd72004ff36')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3ee0369-7a, col_values=(('external_ids', {'iface-id': 'f3ee0369-7aca-4c21-8798-c9158cc47bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:93:2a', 'vm-uuid': '34e3ad13-abe7-4167-9d8c-474f59397b6e'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:37 user nova-compute[74241]: INFO os_vif [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a')
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] No VIF found with MAC fa:16:3e:68:93:2a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:34:37 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully created port: 8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully created port: ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-5965a5a5-81e5-4e18-9075-8fdd5966f81a req-3bff3ca8-fffb-441f-bf51-d498369533bb service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5965a5a5-81e5-4e18-9075-8fdd5966f81a req-3bff3ca8-fffb-441f-bf51-d498369533bb service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5965a5a5-81e5-4e18-9075-8fdd5966f81a req-3bff3ca8-fffb-441f-bf51-d498369533bb service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5965a5a5-81e5-4e18-9075-8fdd5966f81a req-3bff3ca8-fffb-441f-bf51-d498369533bb service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-5965a5a5-81e5-4e18-9075-8fdd5966f81a req-3bff3ca8-fffb-441f-bf51-d498369533bb service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] No waiting events found dispatching network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:34:38 user nova-compute[74241]: WARNING nova.compute.manager [req-5965a5a5-81e5-4e18-9075-8fdd5966f81a req-3bff3ca8-fffb-441f-bf51-d498369533bb service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received unexpected event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec for instance with vm_state building and task_state spawning.
Oct 20 11:34:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully updated port: 3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-80336183-9fea-429b-835b-126e8abde6ed req-278929a1-55e0-46bc-aa0d-65a2c1722ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-changed-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-80336183-9fea-429b-835b-126e8abde6ed req-278929a1-55e0-46bc-aa0d-65a2c1722ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing instance network info cache due to event network-changed-3a371ba7-fd54-4cad-8a82-230fcddc7baf. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-80336183-9fea-429b-835b-126e8abde6ed req-278929a1-55e0-46bc-aa0d-65a2c1722ca3 service nova] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-80336183-9fea-429b-835b-126e8abde6ed req-278929a1-55e0-46bc-aa0d-65a2c1722ca3 service nova] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG nova.network.neutron [req-80336183-9fea-429b-835b-126e8abde6ed req-278929a1-55e0-46bc-aa0d-65a2c1722ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing network info cache for port 3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG nova.network.neutron [req-80336183-9fea-429b-835b-126e8abde6ed req-278929a1-55e0-46bc-aa0d-65a2c1722ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG nova.network.neutron [req-80336183-9fea-429b-835b-126e8abde6ed req-278929a1-55e0-46bc-aa0d-65a2c1722ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-80336183-9fea-429b-835b-126e8abde6ed req-278929a1-55e0-46bc-aa0d-65a2c1722ca3 service nova] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully updated port: 2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:40 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully updated port: 53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:34:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:34:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance spawned successfully.
Oct 20 11:34:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-f148a420-89e2-429d-b9ff-9068e5a58e18 req-a129bcb9-56f7-4602-90ae-150fe4abe335 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f148a420-89e2-429d-b9ff-9068e5a58e18 req-a129bcb9-56f7-4602-90ae-150fe4abe335 service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f148a420-89e2-429d-b9ff-9068e5a58e18 req-a129bcb9-56f7-4602-90ae-150fe4abe335 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f148a420-89e2-429d-b9ff-9068e5a58e18 req-a129bcb9-56f7-4602-90ae-150fe4abe335 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-f148a420-89e2-429d-b9ff-9068e5a58e18 req-a129bcb9-56f7-4602-90ae-150fe4abe335 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] No waiting events found dispatching network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:34:41 user nova-compute[74241]: WARNING nova.compute.manager [req-f148a420-89e2-429d-b9ff-9068e5a58e18 req-a129bcb9-56f7-4602-90ae-150fe4abe335 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received unexpected event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec for instance with vm_state building and task_state spawning.
Oct 20 11:34:41 user nova-compute[74241]: INFO nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Took 5.22 seconds to spawn the instance on the hypervisor.
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully updated port: 1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:41 user nova-compute[74241]: INFO nova.compute.manager [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Took 37.34 seconds to build instance.
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-91773773-d0ca-4984-9afd-369ed8d40f8a tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.473s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-changed-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing instance network info cache due to event network-changed-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing network info cache for port 2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-changed-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing instance network info cache due to event network-changed-53e1bac0-1951-49d1-9086-7c35a689302a. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing network info cache for port 53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully updated port: 9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-changed-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing instance network info cache due to event network-changed-1c415635-1c86-40b7-b0fb-9e2d3a59f99c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing network info cache for port 1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-659a6d0f-0436-4b55-aa55-ec073079df35 req-e950fc6d-a5cf-488c-9715-6a05e6a5a4f3 service nova] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully updated port: 8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-f6a001b5-e334-458b-abcd-584f252b4e43 req-f4041169-808c-4fb1-85c7-70ed1c600ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-changed-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-f6a001b5-e334-458b-abcd-584f252b4e43 req-f4041169-808c-4fb1-85c7-70ed1c600ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing instance network info cache due to event network-changed-8ecedd0d-0cb3-496c-a244-ddd03b914c72. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f6a001b5-e334-458b-abcd-584f252b4e43 req-f4041169-808c-4fb1-85c7-70ed1c600ca3 service nova] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f6a001b5-e334-458b-abcd-584f252b4e43 req-f4041169-808c-4fb1-85c7-70ed1c600ca3 service nova] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-f6a001b5-e334-458b-abcd-584f252b4e43 req-f4041169-808c-4fb1-85c7-70ed1c600ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing network info cache for port 8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-f6a001b5-e334-458b-abcd-584f252b4e43 req-f4041169-808c-4fb1-85c7-70ed1c600ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-f6a001b5-e334-458b-abcd-584f252b4e43 req-f4041169-808c-4fb1-85c7-70ed1c600ca3 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f6a001b5-e334-458b-abcd-584f252b4e43 req-f4041169-808c-4fb1-85c7-70ed1c600ca3 service nova] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-c0af4836-31a0-4058-8c62-ed2463c60be7 req-28db09dd-0344-4af8-ad26-3789ada65539 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-changed-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-c0af4836-31a0-4058-8c62-ed2463c60be7 req-28db09dd-0344-4af8-ad26-3789ada65539 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing instance network info cache due to event network-changed-9561b356-3304-4c7e-a845-24f13ad20859. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c0af4836-31a0-4058-8c62-ed2463c60be7 req-28db09dd-0344-4af8-ad26-3789ada65539 service nova] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c0af4836-31a0-4058-8c62-ed2463c60be7 req-28db09dd-0344-4af8-ad26-3789ada65539 service nova] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-c0af4836-31a0-4058-8c62-ed2463c60be7 req-28db09dd-0344-4af8-ad26-3789ada65539 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing network info cache for port 9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-c0af4836-31a0-4058-8c62-ed2463c60be7 req-28db09dd-0344-4af8-ad26-3789ada65539 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Successfully updated port: ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-c0af4836-31a0-4058-8c62-ed2463c60be7 req-28db09dd-0344-4af8-ad26-3789ada65539 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c0af4836-31a0-4058-8c62-ed2463c60be7 req-28db09dd-0344-4af8-ad26-3789ada65539 service nova] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:34:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-7f1bb024-407c-48d2-8dd4-f5515fb36083 req-02701c32-1afb-44f0-8b4c-01770377e562 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-changed-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-7f1bb024-407c-48d2-8dd4-f5515fb36083 req-02701c32-1afb-44f0-8b4c-01770377e562 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing instance network info cache due to event network-changed-ba10ed3b-572a-4460-a5e5-597cd6dcd6af. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7f1bb024-407c-48d2-8dd4-f5515fb36083 req-02701c32-1afb-44f0-8b4c-01770377e562 service nova] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:45 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:45 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:45 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:45 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:34:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:45 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG nova.network.neutron [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [{"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance network_info: |[{"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7f1bb024-407c-48d2-8dd4-f5515fb36083 req-02701c32-1afb-44f0-8b4c-01770377e562 service nova] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG nova.network.neutron [req-7f1bb024-407c-48d2-8dd4-f5515fb36083 req-02701c32-1afb-44f0-8b4c-01770377e562 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing network info cache for port ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:34:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG nova.network.neutron [req-7f1bb024-407c-48d2-8dd4-f5515fb36083 req-02701c32-1afb-44f0-8b4c-01770377e562 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updated VIF entry in instance network info cache for port ba10ed3b-572a-4460-a5e5-597cd6dcd6af. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG nova.network.neutron [req-7f1bb024-407c-48d2-8dd4-f5515fb36083 req-02701c32-1afb-44f0-8b4c-01770377e562 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [{"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7f1bb024-407c-48d2-8dd4-f5515fb36083 req-02701c32-1afb-44f0-8b4c-01770377e562 service nova] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-daa786fb-defd-4d51-bf49-c68907b51780 req-ac4eae55-e5e4-48f5-b64c-cd0e1494c1e9 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-changed-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-daa786fb-defd-4d51-bf49-c68907b51780 req-ac4eae55-e5e4-48f5-b64c-cd0e1494c1e9 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Refreshing instance network info cache due to event network-changed-08303d9d-06cf-4e8a-a348-f1475340cb3c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-daa786fb-defd-4d51-bf49-c68907b51780 req-ac4eae55-e5e4-48f5-b64c-cd0e1494c1e9 service nova] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-daa786fb-defd-4d51-bf49-c68907b51780 req-ac4eae55-e5e4-48f5-b64c-cd0e1494c1e9 service nova] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:48 user nova-compute[74241]: DEBUG nova.network.neutron [req-daa786fb-defd-4d51-bf49-c68907b51780 req-ac4eae55-e5e4-48f5-b64c-cd0e1494c1e9 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Refreshing network info cache for port 08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG nova.network.neutron [req-daa786fb-defd-4d51-bf49-c68907b51780 req-ac4eae55-e5e4-48f5-b64c-cd0e1494c1e9 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updated VIF entry in instance network info cache for port 08303d9d-06cf-4e8a-a348-f1475340cb3c. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG nova.network.neutron [req-daa786fb-defd-4d51-bf49-c68907b51780 req-ac4eae55-e5e4-48f5-b64c-cd0e1494c1e9 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-daa786fb-defd-4d51-bf49-c68907b51780 req-ac4eae55-e5e4-48f5-b64c-cd0e1494c1e9 service nova] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:34:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7435MB free_disk=25.632598876953125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6a1b5fb2-449e-4648-8dc0-276813417b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d128bb7d-42b2-4d1a-94c0-de749ec2235c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9f326446-5aa8-47f0-bc97-0f2c9664319f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 34e3ad13-abe7-4167-9d8c-474f59397b6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ed711b9c-3bfc-41c9-8a33-725ffa363a56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:34:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:34:50 user nova-compute[74241]: INFO nova.compute.manager [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] instance snapshotting
Oct 20 11:34:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Beginning live snapshot process
Oct 20 11:34:51 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json -f qcow2 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json -f qcow2 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-1f45e1b7-b05e-40dd-a942-d738415a5b3d req-add42a40-4e01-4f4e-b817-8cd5c5ecc471 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-changed-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-1f45e1b7-b05e-40dd-a942-d738415a5b3d req-add42a40-4e01-4f4e-b817-8cd5c5ecc471 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Refreshing instance network info cache due to event network-changed-504064ac-206b-4ceb-9eb0-e87b8bfee408. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1f45e1b7-b05e-40dd-a942-d738415a5b3d req-add42a40-4e01-4f4e-b817-8cd5c5ecc471 service nova] Acquiring lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1f45e1b7-b05e-40dd-a942-d738415a5b3d req-add42a40-4e01-4f4e-b817-8cd5c5ecc471 service nova] Acquired lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG nova.network.neutron [req-1f45e1b7-b05e-40dd-a942-d738415a5b3d req-add42a40-4e01-4f4e-b817-8cd5c5ecc471 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Refreshing network info cache for port 504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdec2ncm7/dcf24196cbc741d19f4cda5df6254482.delta 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdec2ncm7/dcf24196cbc741d19f4cda5df6254482.delta 1073741824" returned: 0 in 0.052s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 11:34:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74241) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 20 11:34:51 user nova-compute[74241]: INFO nova.virt.libvirt.host [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] UEFI support detected
Oct 20 11:34:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-1f45e1b7-b05e-40dd-a942-d738415a5b3d req-add42a40-4e01-4f4e-b817-8cd5c5ecc471 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updated VIF entry in instance network info cache for port 504064ac-206b-4ceb-9eb0-e87b8bfee408. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:34:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-1f45e1b7-b05e-40dd-a942-d738415a5b3d req-add42a40-4e01-4f4e-b817-8cd5c5ecc471 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1f45e1b7-b05e-40dd-a942-d738415a5b3d req-add42a40-4e01-4f4e-b817-8cd5c5ecc471 service nova] Releasing lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:34:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:34:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:34:53 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 11:34:53 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:34:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdec2ncm7/dcf24196cbc741d19f4cda5df6254482.delta /opt/stack/data/nova/instances/snapshots/tmpdec2ncm7/dcf24196cbc741d19f4cda5df6254482 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdec2ncm7/dcf24196cbc741d19f4cda5df6254482.delta /opt/stack/data/nova/instances/snapshots/tmpdec2ncm7/dcf24196cbc741d19f4cda5df6254482" returned: 0 in 0.688s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Snapshot extracted, beginning image upload
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Acquiring lock "3c73caa8-a299-41e1-bd85-66299f6641f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Lock "3c73caa8-a299-41e1-bd85-66299f6641f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:34:55 user nova-compute[74241]: INFO nova.compute.claims [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Claim successful on node user
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:34:55 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:34:55 user nova-compute[74241]: INFO nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Booting with volume 33855670-3ed6-49b6-8476-289acdfd3483 at /dev/vda
Oct 20 11:34:55 user nova-compute[74241]: DEBUG nova.policy [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '207aeccc45bd4134bd5e8f30d69e5cb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ffbdeb90da4caba0f0e4c73e5efe6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG os_brick.utils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[469b667b-128d-4d17-ba46-8f8b2ff44d58]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14d53ee-1e52-4e8f-a954-404b4a841be2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef36553-cecd-4d05-8c4a-e4b6f6450200]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7117cf-c6fd-4a5c-a3ec-28aa20a7bbf5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:34:56 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:34:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac27504-584b-4321-8c4e-6cc2c01ec611]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG os_brick.utils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating existing volume attachment record: 7464a648-5f6d-4a13-a42f-ced47db3877c {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:56 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully created port: 8f2dab0b-7264-471a-83bb-75d6dcdae095 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:57 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Snapshot image upload complete
Oct 20 11:34:57 user nova-compute[74241]: INFO nova.compute.manager [None req-6a2b4e4e-0fc4-43fa-b96f-5efbf2bff6d3 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Took 6.17 seconds to snapshot the instance on the hypervisor.
Oct 20 11:34:57 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully created port: 2484c0ad-eccd-4f77-80b7-14b5057c00ed {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:34:57 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully created port: 781e6c5c-a3ca-48f7-9bb4-0beccdc930a6 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully created port: 89e8e528-8a4f-4d1d-ba34-27a0d1511ce0 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully created port: 2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully updated port: 8f2dab0b-7264-471a-83bb-75d6dcdae095 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-cbaa16c1-6274-4573-976f-d63b92a38acf req-801cbf22-60f5-4dad-bdc7-06a1d05eec00 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Received event network-changed-8f2dab0b-7264-471a-83bb-75d6dcdae095 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-cbaa16c1-6274-4573-976f-d63b92a38acf req-801cbf22-60f5-4dad-bdc7-06a1d05eec00 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing instance network info cache due to event network-changed-8f2dab0b-7264-471a-83bb-75d6dcdae095. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cbaa16c1-6274-4573-976f-d63b92a38acf req-801cbf22-60f5-4dad-bdc7-06a1d05eec00 service nova] Acquiring lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cbaa16c1-6274-4573-976f-d63b92a38acf req-801cbf22-60f5-4dad-bdc7-06a1d05eec00 service nova] Acquired lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG nova.network.neutron [req-cbaa16c1-6274-4573-976f-d63b92a38acf req-801cbf22-60f5-4dad-bdc7-06a1d05eec00 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing network info cache for port 8f2dab0b-7264-471a-83bb-75d6dcdae095 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG nova.network.neutron [req-cbaa16c1-6274-4573-976f-d63b92a38acf req-801cbf22-60f5-4dad-bdc7-06a1d05eec00 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG nova.network.neutron [req-cbaa16c1-6274-4573-976f-d63b92a38acf req-801cbf22-60f5-4dad-bdc7-06a1d05eec00 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:34:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cbaa16c1-6274-4573-976f-d63b92a38acf req-801cbf22-60f5-4dad-bdc7-06a1d05eec00 service nova] Releasing lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully updated port: ac475a91-3125-4cab-9930-27b5757b31aa {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:35:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully updated port: afbf0e19-2c57-4036-8b9e-b775900c827d {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully updated port: 2484c0ad-eccd-4f77-80b7-14b5057c00ed {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Received event network-changed-ac475a91-3125-4cab-9930-27b5757b31aa {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing instance network info cache due to event network-changed-ac475a91-3125-4cab-9930-27b5757b31aa. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Acquiring lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Acquired lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing network info cache for port ac475a91-3125-4cab-9930-27b5757b31aa {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Releasing lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Received event network-changed-afbf0e19-2c57-4036-8b9e-b775900c827d {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing instance network info cache due to event network-changed-afbf0e19-2c57-4036-8b9e-b775900c827d. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Acquiring lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Acquired lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing network info cache for port afbf0e19-2c57-4036-8b9e-b775900c827d {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Releasing lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Received event network-changed-2484c0ad-eccd-4f77-80b7-14b5057c00ed {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing instance network info cache due to event network-changed-2484c0ad-eccd-4f77-80b7-14b5057c00ed. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Acquiring lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Acquired lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing network info cache for port 2484c0ad-eccd-4f77-80b7-14b5057c00ed {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.network.neutron [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3ae523bb-c0cc-4739-ad37-b1a299769a4f req-4043be77-1e28-425b-994c-766b6e6f5327 service nova] Releasing lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully updated port: 781e6c5c-a3ca-48f7-9bb4-0beccdc930a6 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lazy-loading 'flavor' on Instance uuid 6a1b5fb2-449e-4648-8dc0-276813417b1d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:03 user nova-compute[74241]: INFO nova.compute.manager [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Attaching volume f7e3a4de-1a57-4b9d-b9c3-450e32149378 to /dev/vdb
Oct 20 11:35:03 user nova-compute[74241]: DEBUG os_brick.utils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[38533f3c-00e3-4433-ae8c-3e7d9bb3423b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dce2e67-8cc7-42be-98c3-124499a72669]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully updated port: 89e8e528-8a4f-4d1d-ba34-27a0d1511ce0 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a69a608-2f91-471a-80ff-b6cb22b93591]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed94207-c256-4367-909b-5ddaad68d711]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:03 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:35:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37b65b5-05a0-4b49-9a8b-0d25cd827c4c]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG os_brick.utils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:03 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Updating existing volume attachment record: 1f72772d-fc63-452d-8238-c77d13d7f609 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:35:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Successfully updated port: 2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:35:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Acquiring lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Acquired lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:35:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:35:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Received event network-changed-781e6c5c-a3ca-48f7-9bb4-0beccdc930a6 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing instance network info cache due to event network-changed-781e6c5c-a3ca-48f7-9bb4-0beccdc930a6. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Acquiring lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [{"id": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "address": "fa:16:3e:96:1e:b4", "network": {"id": "513bbe18-a8ff-4022-b760-244a3f8db2f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-522003391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2dab0b-72", "ovs_interfaceid": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac475a91-3125-4cab-9930-27b5757b31aa", "address": "fa:16:3e:ec:d8:2e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac475a91-31", "ovs_interfaceid": "ac475a91-3125-4cab-9930-27b5757b31aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afbf0e19-2c57-4036-8b9e-b775900c827d", "address": "fa:16:3e:64:c4:3e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbf0e19-2c", "ovs_interfaceid": "afbf0e19-2c57-4036-8b9e-b775900c827d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "address": "fa:16:3e:67:63:17", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2484c0ad-ec", "ovs_interfaceid": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "address": "fa:16:3e:5f:49:1c", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781e6c5c-a3", "ovs_interfaceid": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "address": "fa:16:3e:a7:7c:f7", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e8e528-8a", "ovs_interfaceid": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "address": "fa:16:3e:e5:e0:4f", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9e5df6-b2", "ovs_interfaceid": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Releasing lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Instance network_info: |[{"id": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "address": "fa:16:3e:96:1e:b4", "network": {"id": "513bbe18-a8ff-4022-b760-244a3f8db2f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-522003391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2dab0b-72", "ovs_interfaceid": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac475a91-3125-4cab-9930-27b5757b31aa", "address": "fa:16:3e:ec:d8:2e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac475a91-31", "ovs_interfaceid": "ac475a91-3125-4cab-9930-27b5757b31aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afbf0e19-2c57-4036-8b9e-b775900c827d", "address": "fa:16:3e:64:c4:3e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbf0e19-2c", "ovs_interfaceid": "afbf0e19-2c57-4036-8b9e-b775900c827d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "address": "fa:16:3e:67:63:17", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2484c0ad-ec", "ovs_interfaceid": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "address": "fa:16:3e:5f:49:1c", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781e6c5c-a3", "ovs_interfaceid": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "address": "fa:16:3e:a7:7c:f7", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e8e528-8a", "ovs_interfaceid": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "address": "fa:16:3e:e5:e0:4f", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9e5df6-b2", "ovs_interfaceid": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Acquired lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing network info cache for port 781e6c5c-a3ca-48f7-9bb4-0beccdc930a6 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updated VIF entry in instance network info cache for port 781e6c5c-a3ca-48f7-9bb4-0beccdc930a6. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [{"id": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "address": "fa:16:3e:96:1e:b4", "network": {"id": "513bbe18-a8ff-4022-b760-244a3f8db2f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-522003391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2dab0b-72", "ovs_interfaceid": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac475a91-3125-4cab-9930-27b5757b31aa", "address": "fa:16:3e:ec:d8:2e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac475a91-31", "ovs_interfaceid": "ac475a91-3125-4cab-9930-27b5757b31aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afbf0e19-2c57-4036-8b9e-b775900c827d", "address": "fa:16:3e:64:c4:3e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbf0e19-2c", "ovs_interfaceid": "afbf0e19-2c57-4036-8b9e-b775900c827d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "address": "fa:16:3e:67:63:17", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2484c0ad-ec", "ovs_interfaceid": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "address": "fa:16:3e:5f:49:1c", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781e6c5c-a3", "ovs_interfaceid": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "address": "fa:16:3e:a7:7c:f7", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e8e528-8a", "ovs_interfaceid": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "address": "fa:16:3e:e5:e0:4f", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9e5df6-b2", "ovs_interfaceid": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Releasing lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Received event network-changed-89e8e528-8a4f-4d1d-ba34-27a0d1511ce0 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing instance network info cache due to event network-changed-89e8e528-8a4f-4d1d-ba34-27a0d1511ce0. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Acquiring lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Acquired lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing network info cache for port 89e8e528-8a4f-4d1d-ba34-27a0d1511ce0 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updated VIF entry in instance network info cache for port 89e8e528-8a4f-4d1d-ba34-27a0d1511ce0. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [{"id": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "address": "fa:16:3e:96:1e:b4", "network": {"id": "513bbe18-a8ff-4022-b760-244a3f8db2f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-522003391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2dab0b-72", "ovs_interfaceid": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac475a91-3125-4cab-9930-27b5757b31aa", "address": "fa:16:3e:ec:d8:2e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac475a91-31", "ovs_interfaceid": "ac475a91-3125-4cab-9930-27b5757b31aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afbf0e19-2c57-4036-8b9e-b775900c827d", "address": "fa:16:3e:64:c4:3e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbf0e19-2c", "ovs_interfaceid": "afbf0e19-2c57-4036-8b9e-b775900c827d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "address": "fa:16:3e:67:63:17", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2484c0ad-ec", "ovs_interfaceid": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "address": "fa:16:3e:5f:49:1c", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781e6c5c-a3", "ovs_interfaceid": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "address": "fa:16:3e:a7:7c:f7", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e8e528-8a", "ovs_interfaceid": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "address": "fa:16:3e:e5:e0:4f", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9e5df6-b2", "ovs_interfaceid": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Releasing lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Received event network-changed-2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing instance network info cache due to event network-changed-2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Acquiring lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Acquired lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Refreshing network info cache for port 2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updated VIF entry in instance network info cache for port 2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG nova.network.neutron [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [{"id": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "address": "fa:16:3e:96:1e:b4", "network": {"id": "513bbe18-a8ff-4022-b760-244a3f8db2f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-522003391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2dab0b-72", "ovs_interfaceid": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ac475a91-3125-4cab-9930-27b5757b31aa", "address": "fa:16:3e:ec:d8:2e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac475a91-31", "ovs_interfaceid": "ac475a91-3125-4cab-9930-27b5757b31aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "afbf0e19-2c57-4036-8b9e-b775900c827d", "address": "fa:16:3e:64:c4:3e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbf0e19-2c", "ovs_interfaceid": "afbf0e19-2c57-4036-8b9e-b775900c827d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "address": "fa:16:3e:67:63:17", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2484c0ad-ec", "ovs_interfaceid": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "address": "fa:16:3e:5f:49:1c", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781e6c5c-a3", "ovs_interfaceid": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "address": "fa:16:3e:a7:7c:f7", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e8e528-8a", "ovs_interfaceid": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "address": "fa:16:3e:e5:e0:4f", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9e5df6-b2", "ovs_interfaceid": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bb4ef15-d32e-4115-ad54-d33b2d18adde req-37d567c3-a116-455e-a570-fc77d639eb3f service nova] Releasing lock "refresh_cache-3c73caa8-a299-41e1-bd85-66299f6641f1" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-0f18f510-bd67-4f01-ad72-c6f71efc6eee req-5d52448b-1ecb-467b-b0e7-7408489b1fd2 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received event network-changed-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-0f18f510-bd67-4f01-ad72-c6f71efc6eee req-5d52448b-1ecb-467b-b0e7-7408489b1fd2 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Refreshing instance network info cache due to event network-changed-491c6c41-5608-42cd-a9d5-a1893dbbacf9. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0f18f510-bd67-4f01-ad72-c6f71efc6eee req-5d52448b-1ecb-467b-b0e7-7408489b1fd2 service nova] Acquiring lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0f18f510-bd67-4f01-ad72-c6f71efc6eee req-5d52448b-1ecb-467b-b0e7-7408489b1fd2 service nova] Acquired lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:07 user nova-compute[74241]: DEBUG nova.network.neutron [req-0f18f510-bd67-4f01-ad72-c6f71efc6eee req-5d52448b-1ecb-467b-b0e7-7408489b1fd2 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Refreshing network info cache for port 491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:08 user nova-compute[74241]: DEBUG nova.network.neutron [req-0f18f510-bd67-4f01-ad72-c6f71efc6eee req-5d52448b-1ecb-467b-b0e7-7408489b1fd2 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updated VIF entry in instance network info cache for port 491c6c41-5608-42cd-a9d5-a1893dbbacf9. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:08 user nova-compute[74241]: DEBUG nova.network.neutron [req-0f18f510-bd67-4f01-ad72-c6f71efc6eee req-5d52448b-1ecb-467b-b0e7-7408489b1fd2 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updating instance_info_cache with network_info: [{"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0f18f510-bd67-4f01-ad72-c6f71efc6eee req-5d52448b-1ecb-467b-b0e7-7408489b1fd2 service nova] Releasing lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-3d65c096-4989-4ac1-b272-e6e4d875d416 req-53f9ff93-acac-497e-8234-4e7b4f729c3a service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received event network-changed-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-3d65c096-4989-4ac1-b272-e6e4d875d416 req-53f9ff93-acac-497e-8234-4e7b4f729c3a service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Refreshing instance network info cache due to event network-changed-8604e215-a83b-4c89-8bea-f37fcc7683cc. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3d65c096-4989-4ac1-b272-e6e4d875d416 req-53f9ff93-acac-497e-8234-4e7b4f729c3a service nova] Acquiring lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3d65c096-4989-4ac1-b272-e6e4d875d416 req-53f9ff93-acac-497e-8234-4e7b4f729c3a service nova] Acquired lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:14 user nova-compute[74241]: DEBUG nova.network.neutron [req-3d65c096-4989-4ac1-b272-e6e4d875d416 req-53f9ff93-acac-497e-8234-4e7b4f729c3a service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Refreshing network info cache for port 8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:14 user nova-compute[74241]: DEBUG nova.network.neutron [req-3d65c096-4989-4ac1-b272-e6e4d875d416 req-53f9ff93-acac-497e-8234-4e7b4f729c3a service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updated VIF entry in instance network info cache for port 8604e215-a83b-4c89-8bea-f37fcc7683cc. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:14 user nova-compute[74241]: DEBUG nova.network.neutron [req-3d65c096-4989-4ac1-b272-e6e4d875d416 req-53f9ff93-acac-497e-8234-4e7b4f729c3a service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updating instance_info_cache with network_info: [{"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3d65c096-4989-4ac1-b272-e6e4d875d416 req-53f9ff93-acac-497e-8234-4e7b4f729c3a service nova] Releasing lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-1164f767-12b1-400c-a081-6f3baf6be493 req-4aabe814-a626-4c33-875c-8bfc8eeb0618 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received event network-changed-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-1164f767-12b1-400c-a081-6f3baf6be493 req-4aabe814-a626-4c33-875c-8bfc8eeb0618 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Refreshing instance network info cache due to event network-changed-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1164f767-12b1-400c-a081-6f3baf6be493 req-4aabe814-a626-4c33-875c-8bfc8eeb0618 service nova] Acquiring lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1164f767-12b1-400c-a081-6f3baf6be493 req-4aabe814-a626-4c33-875c-8bfc8eeb0618 service nova] Acquired lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-1164f767-12b1-400c-a081-6f3baf6be493 req-4aabe814-a626-4c33-875c-8bfc8eeb0618 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Refreshing network info cache for port f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lazy-loading 'flavor' on Instance uuid d77d035b-ec54-4c5e-8dd6-55e5297b02fb {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:19 user nova-compute[74241]: INFO nova.virt.block_device [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Booting with volume 3a9000a6-adfc-4e05-9536-717f628c2fb1 at /dev/vdb
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.124s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-1164f767-12b1-400c-a081-6f3baf6be493 req-4aabe814-a626-4c33-875c-8bfc8eeb0618 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Updated VIF entry in instance network info cache for port f0ddf1fc-cdd1-44a5-96a6-afc986e60c34. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-1164f767-12b1-400c-a081-6f3baf6be493 req-4aabe814-a626-4c33-875c-8bfc8eeb0618 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Updating instance_info_cache with network_info: [{"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1164f767-12b1-400c-a081-6f3baf6be493 req-4aabe814-a626-4c33-875c-8bfc8eeb0618 service nova] Releasing lock "refresh_cache-d128bb7d-42b2-4d1a-94c0-de749ec2235c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG os_brick.utils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8831179f-71c1-4eca-94d9-ffce5a6649b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d5c103-d210-44b9-a3a1-4e04278e4d03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb7c707-8cac-4fe3-9e5d-f4a1149b03e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a80b5df-83ca-412a-ade3-aaf771e4f5ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:19 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb050868-8568-4302-a023-f2cbadcf8d59]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG os_brick.utils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating existing volume attachment record: e09e15ea-c2f1-4ad4-98ee-fca9357d0c74 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:19 user nova-compute[74241]: INFO nova.compute.manager [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Attaching volume c2ef804d-dc18-47c8-9809-8a29ea62bdbc to /dev/vdb
Oct 20 11:35:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-4c8708a6-dbec-418d-b279-f8eb0fa5a4da req-6edb31b4-a8a7-4c3d-846a-1c2651d29396 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-changed-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-4c8708a6-dbec-418d-b279-f8eb0fa5a4da req-6edb31b4-a8a7-4c3d-846a-1c2651d29396 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Refreshing instance network info cache due to event network-changed-88fde83f-c742-460e-8d1a-78982cbb685e. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4c8708a6-dbec-418d-b279-f8eb0fa5a4da req-6edb31b4-a8a7-4c3d-846a-1c2651d29396 service nova] Acquiring lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4c8708a6-dbec-418d-b279-f8eb0fa5a4da req-6edb31b4-a8a7-4c3d-846a-1c2651d29396 service nova] Acquired lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:22 user nova-compute[74241]: DEBUG nova.network.neutron [req-4c8708a6-dbec-418d-b279-f8eb0fa5a4da req-6edb31b4-a8a7-4c3d-846a-1c2651d29396 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Refreshing network info cache for port 88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG nova.network.neutron [req-4c8708a6-dbec-418d-b279-f8eb0fa5a4da req-6edb31b4-a8a7-4c3d-846a-1c2651d29396 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updated VIF entry in instance network info cache for port 88fde83f-c742-460e-8d1a-78982cbb685e. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG nova.network.neutron [req-4c8708a6-dbec-418d-b279-f8eb0fa5a4da req-6edb31b4-a8a7-4c3d-846a-1c2651d29396 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating instance_info_cache with network_info: [{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4c8708a6-dbec-418d-b279-f8eb0fa5a4da req-6edb31b4-a8a7-4c3d-846a-1c2651d29396 service nova] Releasing lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "interface-726a7f29-03b0-489f-a77d-9a77e5c4a546-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "interface-726a7f29-03b0-489f-a77d-9a77e5c4a546-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG nova.objects.instance [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lazy-loading 'flavor' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG nova.objects.instance [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lazy-loading 'pci_requests' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG nova.objects.base [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Object Instance<726a7f29-03b0-489f-a77d-9a77e5c4a546> lazy-loaded attributes: flavor,pci_requests {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:35:23 user nova-compute[74241]: DEBUG nova.policy [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16555d6cef90422db4c851511083a34f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb28511a3ff4f30bffdd7c8aa870c39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:35:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Successfully created port: 2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Successfully updated port: 2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquired lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-3761768a-0766-4139-80c3-fdf8a52f22f1 req-c58d3b49-961b-4637-bf74-4b5105904cc7 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-changed-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-3761768a-0766-4139-80c3-fdf8a52f22f1 req-c58d3b49-961b-4637-bf74-4b5105904cc7 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Refreshing instance network info cache due to event network-changed-2348d99b-d4b3-4938-ab06-ab5aa38e5116. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3761768a-0766-4139-80c3-fdf8a52f22f1 req-c58d3b49-961b-4637-bf74-4b5105904cc7 service nova] Acquiring lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating instance_info_cache with network_info: [{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Releasing lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3761768a-0766-4139-80c3-fdf8a52f22f1 req-c58d3b49-961b-4637-bf74-4b5105904cc7 service nova] Acquired lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.network.neutron [req-3761768a-0766-4139-80c3-fdf8a52f22f1 req-c58d3b49-961b-4637-bf74-4b5105904cc7 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Refreshing network info cache for port 2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converting VIF {"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG os_vif [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '653ae831-5c0d-5d45-bc57-dd1fc49c3ac7', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2348d99b-d4, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2348d99b-d4, col_values=(('qos', UUID('58bc6ba8-1c65-4cdd-9b12-0df537f1ed78')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2348d99b-d4, col_values=(('external_ids', {'iface-id': '2348d99b-d4b3-4938-ab06-ab5aa38e5116', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:c5:d6', 'vm-uuid': '726a7f29-03b0-489f-a77d-9a77e5c4a546'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:25 user nova-compute[74241]: INFO os_vif [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4')
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converting VIF {"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] attach device xml: <interface type="ethernet">
Oct 20 11:35:25 user nova-compute[74241]:   <mac address="fa:16:3e:fc:c5:d6"/>
Oct 20 11:35:25 user nova-compute[74241]:   <model type="virtio"/>
Oct 20 11:35:25 user nova-compute[74241]:   <mtu size="1442"/>
Oct 20 11:35:25 user nova-compute[74241]:   <target dev="tap2348d99b-d4"/>
Oct 20 11:35:25 user nova-compute[74241]: </interface>
Oct 20 11:35:25 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-8d9b5e90-5f3e-4c46-9613-1114ea29e03d req-d99d1d0b-4f9b-4034-87f8-b7626ac6a84f service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8d9b5e90-5f3e-4c46-9613-1114ea29e03d req-d99d1d0b-4f9b-4034-87f8-b7626ac6a84f service nova] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8d9b5e90-5f3e-4c46-9613-1114ea29e03d req-d99d1d0b-4f9b-4034-87f8-b7626ac6a84f service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8d9b5e90-5f3e-4c46-9613-1114ea29e03d req-d99d1d0b-4f9b-4034-87f8-b7626ac6a84f service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-8d9b5e90-5f3e-4c46-9613-1114ea29e03d req-d99d1d0b-4f9b-4034-87f8-b7626ac6a84f service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] No waiting events found dispatching network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:35:26 user nova-compute[74241]: WARNING nova.compute.manager [req-8d9b5e90-5f3e-4c46-9613-1114ea29e03d req-d99d1d0b-4f9b-4034-87f8-b7626ac6a84f service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received unexpected event network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 for instance with vm_state active and task_state None.
Oct 20 11:35:26 user nova-compute[74241]: DEBUG nova.network.neutron [req-3761768a-0766-4139-80c3-fdf8a52f22f1 req-c58d3b49-961b-4637-bf74-4b5105904cc7 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updated VIF entry in instance network info cache for port 2348d99b-d4b3-4938-ab06-ab5aa38e5116. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG nova.network.neutron [req-3761768a-0766-4139-80c3-fdf8a52f22f1 req-c58d3b49-961b-4637-bf74-4b5105904cc7 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating instance_info_cache with network_info: [{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3761768a-0766-4139-80c3-fdf8a52f22f1 req-c58d3b49-961b-4637-bf74-4b5105904cc7 service nova] Releasing lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No BDM found with device name hda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No VIF found with MAC fa:16:3e:ae:a1:83, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:35:26 user nova-compute[74241]:   <nova:package version="0.0.0"/>
Oct 20 11:35:26 user nova-compute[74241]:   <nova:name>tempest-device-tagging-server-1761481514</nova:name>
Oct 20 11:35:26 user nova-compute[74241]:   <nova:creationTime>2023-10-20 11:35:26</nova:creationTime>
Oct 20 11:35:26 user nova-compute[74241]:   <nova:flavor name="m1.tiny">
Oct 20 11:35:26 user nova-compute[74241]:     <nova:memory>512</nova:memory>
Oct 20 11:35:26 user nova-compute[74241]:     <nova:disk>1</nova:disk>
Oct 20 11:35:26 user nova-compute[74241]:     <nova:swap>0</nova:swap>
Oct 20 11:35:26 user nova-compute[74241]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:35:26 user nova-compute[74241]:     <nova:vcpus>1</nova:vcpus>
Oct 20 11:35:26 user nova-compute[74241]:   </nova:flavor>
Oct 20 11:35:26 user nova-compute[74241]:   <nova:owner>
Oct 20 11:35:26 user nova-compute[74241]:     <nova:user uuid="16555d6cef90422db4c851511083a34f">tempest-TaggedAttachmentsTest-20080626-project-member</nova:user>
Oct 20 11:35:26 user nova-compute[74241]:     <nova:project uuid="ccb28511a3ff4f30bffdd7c8aa870c39">tempest-TaggedAttachmentsTest-20080626</nova:project>
Oct 20 11:35:26 user nova-compute[74241]:   </nova:owner>
Oct 20 11:35:26 user nova-compute[74241]:   <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:35:26 user nova-compute[74241]:   <nova:ports>
Oct 20 11:35:26 user nova-compute[74241]:     <nova:port uuid="88fde83f-c742-460e-8d1a-78982cbb685e">
Oct 20 11:35:26 user nova-compute[74241]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:35:26 user nova-compute[74241]:     </nova:port>
Oct 20 11:35:26 user nova-compute[74241]:     <nova:port uuid="2348d99b-d4b3-4938-ab06-ab5aa38e5116">
Oct 20 11:35:26 user nova-compute[74241]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Oct 20 11:35:26 user nova-compute[74241]:     </nova:port>
Oct 20 11:35:26 user nova-compute[74241]:   </nova:ports>
Oct 20 11:35:26 user nova-compute[74241]: </nova:instance>
Oct 20 11:35:26 user nova-compute[74241]:  {{(pid=74241) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8922ae97-6cd1-4e5d-ab82-b1d0f8547466 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "interface-726a7f29-03b0-489f-a77d-9a77e5c4a546-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.963s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-446cc562-9345-42db-9800-a2c5b5f3b50f req-4dd01406-7d8c-4922-a01f-a07c443e86a7 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-446cc562-9345-42db-9800-a2c5b5f3b50f req-4dd01406-7d8c-4922-a01f-a07c443e86a7 service nova] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-446cc562-9345-42db-9800-a2c5b5f3b50f req-4dd01406-7d8c-4922-a01f-a07c443e86a7 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-446cc562-9345-42db-9800-a2c5b5f3b50f req-4dd01406-7d8c-4922-a01f-a07c443e86a7 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-446cc562-9345-42db-9800-a2c5b5f3b50f req-4dd01406-7d8c-4922-a01f-a07c443e86a7 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] No waiting events found dispatching network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:35:28 user nova-compute[74241]: WARNING nova.compute.manager [req-446cc562-9345-42db-9800-a2c5b5f3b50f req-4dd01406-7d8c-4922-a01f-a07c443e86a7 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received unexpected event network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 for instance with vm_state active and task_state None.
Oct 20 11:35:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-e8d06dc6-afe4-433f-9dbe-c4b09f32e817 req-d0e236aa-75e3-472a-a512-ee32c79633e0 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received event network-changed-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-e8d06dc6-afe4-433f-9dbe-c4b09f32e817 req-d0e236aa-75e3-472a-a512-ee32c79633e0 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Refreshing instance network info cache due to event network-changed-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e8d06dc6-afe4-433f-9dbe-c4b09f32e817 req-d0e236aa-75e3-472a-a512-ee32c79633e0 service nova] Acquiring lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e8d06dc6-afe4-433f-9dbe-c4b09f32e817 req-d0e236aa-75e3-472a-a512-ee32c79633e0 service nova] Acquired lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:29 user nova-compute[74241]: DEBUG nova.network.neutron [req-e8d06dc6-afe4-433f-9dbe-c4b09f32e817 req-d0e236aa-75e3-472a-a512-ee32c79633e0 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Refreshing network info cache for port 2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:29 user nova-compute[74241]: DEBUG nova.network.neutron [req-e8d06dc6-afe4-433f-9dbe-c4b09f32e817 req-d0e236aa-75e3-472a-a512-ee32c79633e0 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Updated VIF entry in instance network info cache for port 2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:29 user nova-compute[74241]: DEBUG nova.network.neutron [req-e8d06dc6-afe4-433f-9dbe-c4b09f32e817 req-d0e236aa-75e3-472a-a512-ee32c79633e0 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Updating instance_info_cache with network_info: [{"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e8d06dc6-afe4-433f-9dbe-c4b09f32e817 req-d0e236aa-75e3-472a-a512-ee32c79633e0 service nova] Releasing lock "refresh_cache-9f326446-5aa8-47f0-bc97-0f2c9664319f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lazy-loading 'flavor' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG os_brick.utils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG nova.objects.instance [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lazy-loading 'flavor' on Instance uuid 9f326446-5aa8-47f0-bc97-0f2c9664319f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a94c238-cfe1-4a00-85e9-720be7c64d57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e39651-5e50-4734-b30f-c1a76d210659]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1414f8b4-0a04-4498-9638-d6dc9380660f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e192ed-293d-44ec-825d-2f9ecc9ed59e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.125s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:35:37 user nova-compute[74241]: INFO nova.virt.block_device [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Booting with volume 917c1204-4581-40b2-95aa-628068e87e6e at /dev/vdc
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:37 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efaf592-5f8f-4481-8af6-56a6c0a3686f]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG os_brick.utils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updating existing volume attachment record: 1c9a22b2-3401-4104-b14d-88ab7ceb3061 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:38 user nova-compute[74241]: DEBUG nova.objects.instance [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lazy-loading 'flavor' on Instance uuid 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKFXUVnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:40 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:35:40 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:35:40 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b82d0b8-d4f5-4062-b79e-45a8af1c2529]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:35:40 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ec3be-a690-4804-98db-070668c425f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378] added
Oct 20 11:35:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:40 user nova-compute[74241]: INFO nova.compute.manager [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Attaching volume 04e7867b-9132-40f0-8536-c0f807ccc13a to /dev/vdb
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4870456f-6f49-4b46-ac03-b6c38818d849]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.utils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23ff851-888a-4507-9dbc-1cbccd4ace29]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKFXUVnZ {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce7598e-658f-4b8f-9f88-2f4b4d5c4f1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RKFXUVnZ" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[791094d5-fb1f-42c1-afeb-084838cc410a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RKFXUVnZ'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca762db-f8d3-49c3-b48c-a0b400de3fb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c6fc3-e1cf-417b-93cd-0a9a6d33f732]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2f7534-a181-4794-abc5-cc7cc4a4960a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0ab1e4-b84b-4392-910b-1ff54105ebb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe81ce-7772-42dd-babe-bbb450bb3371]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:35:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:35:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:40 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0426650a-88d6-4f4a-a105-a306a45c2955]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.utils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating existing volume attachment record: 325aa69b-5454-4fe5-aa06-9cb98bebc227 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:40 user nova-compute[74241]: INFO nova.compute.manager [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Attaching volume fe3b99c1-eb07-48d8-840e-9fd6b90cf514 to /dev/vdb
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:40 user nova-compute[74241]: INFO nova.compute.manager [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Attaching volume 127f3bca-0e69-48b2-9f07-1c60fb9f79ae to /dev/vdb
Oct 20 11:35:40 user nova-compute[74241]: INFO nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Booting with volume 87083b94-eaa5-487f-a82d-21b0fd7d40a8 at /dev/vdb
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6cb7c6-d70e-4cbb-b03f-fabe1a5e21e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378, portal: 172.16.0.220,3260]
Oct 20 11:35:40 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378, portal: 172.16.0.220,3260] successful.
Oct 20 11:35:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6dc687-7910-4415-b7b5-a401b14e803f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lazy-loading 'flavor' on Instance uuid d128bb7d-42b2-4d1a-94c0-de749ec2235c {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4929068-85d6-4660-81de-5d30e8eedd7f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:35:40 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:35:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:35:40 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:35:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26e39d0-721e-4602-99e9-18b609abdc31]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKFXUVnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:35:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3629dcfb-d9df-43bd-a660-c13660627c27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[81faef4a-de80-4c35-a8de-599d4239172c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b815406-7367-4e6c-8c9b-d64391455fbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[52170839-8c29-4d69-bfd0-d044cb74e0e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:41 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e8fb6c-324b-4e4d-8e02-ebac58a92405]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating existing volume attachment record: 402d4db8-a8c1-4c86-87b1-7de00eea3584 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5725af6e-6707-46b0-b0cf-cc7ad41f78ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a30a56-e7e3-48af-9df0-d32ff0053c37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6a4790-a0ae-46b3-92fe-6afae6c12920]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a94aba4-d783-44a2-8353-3e1b6d3fe322]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cc2e8b-c72b-471c-9107-26a7bfb30f93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0837fc97-62ee-4a10-b0c6-8885685fe286]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[230109ea-b9d0-4af0-9ff4-a082d1026363]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0525d5-e071-49bc-92a8-da6d680afb24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:41 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[920d1944-e718-4994-8bd7-6874e10883b6]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e939e2-bf97-4194-9a2d-58767cee95ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] <== get_connector_properties: return (202ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Updating existing volume attachment record: 3a02f5f7-03a2-46ed-b2ea-6ea12b797ccf {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8093578b-eb5c-4900-b240-a765c0a59753]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ed8336-73b5-4891-81b6-36b75b684152]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4b2ee7-123e-4826-9d90-62f0463e1f3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:41 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[034f4686-219f-4112-a774-10f672f53021]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:41 user nova-compute[74241]: INFO nova.compute.manager [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Attaching volume 2fea6248-ed62-4bb6-b46b-6a891c1ad414 to /dev/sdc
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] <== get_connector_properties: return (281ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updating existing volume attachment record: a3b7803a-14b8-4dea-ab76-d78005ca8e6f {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:35:41 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:35:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf12b8bf-b516-4300-8d32-d2944c7a2a49]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] <== get_connector_properties: return (245ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating existing volume attachment record: 3c0ea674-79c6-4b3b-9627-ecb4118919a2 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23061386233356537', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061386233356537', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:35:41 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lazy-loading 'flavor' on Instance uuid 6a1b5fb2-449e-4648-8dc0-276813417b1d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:35:42 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:35:42 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:35:42 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:35:42 user nova-compute[74241]:   <serial>f7e3a4de-1a57-4b9d-b9c3-450e32149378</serial>
Oct 20 11:35:42 user nova-compute[74241]: </disk>
Oct 20 11:35:42 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:35:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:35:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:35:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] No VIF found with MAC fa:16:3e:b2:e5:2b, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:35:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:35:49 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:35:49 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7510MB free_disk=25.571491241455078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6a1b5fb2-449e-4648-8dc0-276813417b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d128bb7d-42b2-4d1a-94c0-de749ec2235c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9f326446-5aa8-47f0-bc97-0f2c9664319f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 34e3ad13-abe7-4167-9d8c-474f59397b6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ed711b9c-3bfc-41c9-8a33-725ffa363a56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3c73caa8-a299-41e1-bd85-66299f6641f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:35:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:35:50 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:50 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:35:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:50 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:35:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:35:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:35:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:35:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG nova.compute.manager [req-4edfd398-5b30-486d-be1c-54bf5b68364e req-fde5e26f-3675-477d-895b-b91694a2a845 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-changed-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG nova.compute.manager [req-4edfd398-5b30-486d-be1c-54bf5b68364e req-fde5e26f-3675-477d-895b-b91694a2a845 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Refreshing instance network info cache due to event network-changed-f3ee0369-7aca-4c21-8798-c9158cc47bec. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4edfd398-5b30-486d-be1c-54bf5b68364e req-fde5e26f-3675-477d-895b-b91694a2a845 service nova] Acquiring lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4edfd398-5b30-486d-be1c-54bf5b68364e req-fde5e26f-3675-477d-895b-b91694a2a845 service nova] Acquired lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG nova.network.neutron [req-4edfd398-5b30-486d-be1c-54bf5b68364e req-fde5e26f-3675-477d-895b-b91694a2a845 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Refreshing network info cache for port f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG nova.network.neutron [req-4edfd398-5b30-486d-be1c-54bf5b68364e req-fde5e26f-3675-477d-895b-b91694a2a845 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Updated VIF entry in instance network info cache for port f3ee0369-7aca-4c21-8798-c9158cc47bec. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG nova.network.neutron [req-4edfd398-5b30-486d-be1c-54bf5b68364e req-fde5e26f-3675-477d-895b-b91694a2a845 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Updating instance_info_cache with network_info: [{"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4edfd398-5b30-486d-be1c-54bf5b68364e req-fde5e26f-3675-477d-895b-b91694a2a845 service nova] Releasing lock "refresh_cache-34e3ad13-abe7-4167-9d8c-474f59397b6e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:35:55 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:35:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:35:55 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:35:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:35:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:35:55 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:35:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[872114b5-0c7f-458f-b234-c5d4395a4595]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:35:56 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef62e19b-a87f-4d3c-b007-a9a380ee7973]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc] added
Oct 20 11:35:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0839333e-dac5-4dbb-a746-8a458c9d0351]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b886f4e-9c3a-47e2-abdc-764aa275772a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGgbXIAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGgbXIAP" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f500cee-4a66-41f4-bf27-d999c5e8b4cb]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iGgbXIAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0d16c4-ed0f-4d44-95dd-80afcd95ac8c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e319c552-9ef9-4e72-93dc-855e134fb440]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:35:56 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:35:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:35:56 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:35:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --login" returned: 0 in 0.256s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe8aa2d-46ec-4c08-9436-35a51117fc83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260]
Oct 20 11:35:56 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260] successful.
Oct 20 11:35:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb5ce13-a558-45a8-b640-a6bef836057a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[543df5ae-f6be-4d23-9341-95dd1de731e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:35:56 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:35:56 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:35:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:35:56 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:35:56 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:35:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bba629-dea7-4c11-87df-f6454c64c759]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:35:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:35:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.495s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:35:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23363313335313866', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:35:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363313335313866', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:35:57 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lazy-loading 'flavor' on Instance uuid d77d035b-ec54-4c5e-8dd6-55e5297b02fb {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:35:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:35:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:35:57 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:35:57 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:35:57 user nova-compute[74241]:   <serial>c2ef804d-dc18-47c8-9809-8a29ea62bdbc</serial>
Oct 20 11:35:57 user nova-compute[74241]: </disk>
Oct 20 11:35:57 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:35:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:35:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:35:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] No VIF found with MAC fa:16:3e:34:a8:80, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:36:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRmfwLky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:14 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:14 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:14 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6601aa6b-ddc5-45fb-a616-18d3279db87b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:36:14 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[acabb07c-252d-467f-bd9f-4ec7f9806d7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514] added
Oct 20 11:36:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f692ed8a-591b-4363-b7d4-4318fab41272]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac5521d-4d67-4c5d-9524-76e22715b465]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRmfwLky {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GRmfwLky" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4f64e4-e97d-4505-a677-c192c164357d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GRmfwLky'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdfa82f-e328-49e6-a3e8-b7956d203ce2]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb0e3f7-3540-40d6-b7b2-78d89fbe5f1a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34a12a2-217c-41d8-80c9-10173e481e81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514, portal: 172.16.0.220,3260]
Oct 20 11:36:14 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[52db315c-59de-4080-8042-bf460e5ced8a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f497a025-0d46-4484-8244-0eafb57cf32b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:14 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c365f0-d375-4536-97f3-9164fbff71cc]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRmfwLky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23662623233386338', 'path': '/dev/sde'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662623233386338', 'path': '/dev/sde'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lazy-loading 'flavor' on Instance uuid 9f326446-5aa8-47f0-bc97-0f2c9664319f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] attach device xml: <disk type="block" device="disk">
Oct 20 11:36:15 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:15 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:36:15 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:15 user nova-compute[74241]:   <serial>fe3b99c1-eb07-48d8-840e-9fd6b90cf514</serial>
Oct 20 11:36:15 user nova-compute[74241]: </disk>
Oct 20 11:36:15 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] No VIF found with MAC fa:16:3e:9a:41:14, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glizWuTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:16 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:16 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:16 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2becd770-164d-48ba-b842-a7ea43ff5eb3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:36:16 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[09638d6d-8f5f-4e2c-8f64-30c8ccb91f68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a] added
Oct 20 11:36:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a730986c-876e-4fb8-9b9d-d3e8c4017ffb]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2d601-910d-4640-9d36-9cd5ef2980fb]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glizWuTH {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v glizWuTH" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ba657-afa1-4291-bf39-f0e1f34151ce]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'glizWuTH'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1e6577-675f-4090-aa50-05598ad1a9f6]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a055e8a-3152-4e42-bb55-4293822226d4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[335ff861-db88-494c-add6-3f97a6fb71d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a, portal: 172.16.0.220,3260]
Oct 20 11:36:16 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8932e6-d16f-4922-8b59-eb8ef5103a34]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d34cb9-ecd9-4009-a6de-af4a86cdb6d5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:16 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7094cd1-7b4a-42e0-83c3-eec795a5b148]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0c42031d-6755-4c32-af53-2a313c87bd91 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 73.535s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glizWuTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3df995f-195d-4135-951d-d4793eea3e28 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 57.052s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.utils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbe4c83-a7ce-4298-82f8-18b1e8d75d67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d7f1b0-183c-4e8d-af18-1445f874f1ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefcb5f6-dadc-4246-83c3-fdd9c745c1c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b493266-fcb2-4844-a3e2-747517e6282a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:36:16 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:36:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c23c233-d356-4181-b6db-e040158aede7]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.utils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Updating existing volume attachment record: a4ae227c-ce9d-4da4-9fe8-5070eaf9637b {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9383f868-8116-4865-bca7-bfc62fbba05c tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.170s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:36:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Creating image(s)
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Ensure instance console log exists: /opt/stack/data/nova/instances/ed711b9c-3bfc-41c9-8a33-725ffa363a56/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Start _get_guest_xml network_info=[{"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '9b7e96ab-8bb5-4991-951e-a337bef43917', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knDSRhgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56', 'attached_at': '', 'detached_at': '', 'volume_id': '7f25239d-075d-415a-941b-923bad8a992d', 'serial': '7f25239d-075d-415a-941b-923bad8a992d'}, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'attachment_id': 'e09e15ea-c2f1-4ad4-98ee-fca9357d0c74', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmfDsyMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56', 'attached_at': '', 'detached_at': '', 'volume_id': '3a9000a6-adfc-4e05-9536-717f628c2fb1', 'serial': '3a9000a6-adfc-4e05-9536-717f628c2fb1'}, 'disk_bus': 'virtio', 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'attachment_id': '325aa69b-5454-4fe5-aa06-9cb98bebc227', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuWVhOZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56', 'attached_at': '', 'detached_at': '', 'volume_id': '917c1204-4581-40b2-95aa-628068e87e6e', 'serial': '917c1204-4581-40b2-95aa-628068e87e6e'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:36:17 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:36:17 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knDSRhgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:17 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26637313764613436', 'path': '/dev/sdf'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637313764613436', 'path': '/dev/sdf'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.524s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:17 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:17 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lazy-loading 'flavor' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff788fd-962b-430b-bdc6-cca3a9fd15db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:36:17 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:36:17 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:17 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 11:36:17 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:17 user nova-compute[74241]:   <serial>04e7867b-9132-40f0-8536-c0f807ccc13a</serial>
Oct 20 11:36:17 user nova-compute[74241]: </disk>
Oct 20 11:36:17 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee16fe1-9c48-4d6f-b63c-c3de60e2658f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d] added
Oct 20 11:36:17 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9137d42-1eba-4467-8fb5-d944ba408827]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8577457-c9f5-4776-a0e4-730868ce72a6]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knDSRhgU {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v knDSRhgU" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d213d02-3ec6-4745-8223-9b312bf05c3c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'knDSRhgU'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[71533eef-1eff-4d35-b69b-86be9e2130ca]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e6028f-23a3-4190-8c88-1e6a23742206]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:17 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:17 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:17 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:17 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:17 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:17 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:17 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:17 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:17 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:17 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2559282a-3100-4fb4-981b-5b859321cc3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d, portal: 172.16.0.220,3260]
Oct 20 11:36:17 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:17 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d47604-0422-46be-b80b-bed7963281a5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[11051038-cf82-42b4-b6d6-a3307857c881]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:18 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b48d0f-dd43-48a1-af76-bdeed9d655ba]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knDSRhgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No BDM found with device name hda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] No VIF found with MAC fa:16:3e:ae:a1:83, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== connect_volume: return (1856ms) {'type': 'block', 'scsi_wwn': '23532323365393634', 'path': '/dev/sdg'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532323365393634', 'path': '/dev/sdg'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmfDsyMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:19 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:19 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:19 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dcb6ef-6694-47be-83f6-7ef304c9807a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:36:19 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61671ef-9e36-4cf3-ac57-0d694f008b63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1] added
Oct 20 11:36:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[24193101-3153-4944-a9c4-29abf50fee6e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ab6cbc-4386-4640-8f37-4677a604625b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VmfDsyMW {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VmfDsyMW" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aa2461-9fe1-4569-832f-338a9a2ed24c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VmfDsyMW'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0885f3c-12e6-4350-9b42-0cd144606a77]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b767139a-12ae-4772-8997-f41998d47fdb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cbbf1f-7133-428b-8b3d-5608c804a318]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1, portal: 172.16.0.220,3260]
Oct 20 11:36:19 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0fa04b-14b0-4136-a4f4-82df7fcf6e2d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa98f8f-6a85-4a7b-b2fb-d75a20d19460]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:19 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b128cad-5529-4d7a-962f-ed10c9d8d4ca]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmfDsyMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23165613161336536', 'path': '/dev/sdh'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165613161336536', 'path': '/dev/sdh'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuWVhOZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:20 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4270ff7-2faa-4f3d-88ff-fe66f66ad5c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:36:20 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec78191b-f28a-4c8c-b2ca-c7ddcc76ea4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e] added
Oct 20 11:36:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8234c87-7dac-442e-aaf9-2da12469366a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3bc94b-c5bb-492e-b323-100104f185c0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vuWVhOZY {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vuWVhOZY" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdaf443-ab11-4fcc-93dd-ec4148a6e3c5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vuWVhOZY'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e702346-e74b-4e4d-b47f-1082aa2b1c81]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c2418f-3136-476c-ba60-b596e5dacda4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --login" returned: 0 in 0.119s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0d3d5a-c3f6-45fb-82c6-4f51b41cf3a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e, portal: 172.16.0.220,3260]
Oct 20 11:36:20 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8053a-3cc5-4cca-bab4-6c94b271c3a0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e307ce-1a7e-4ecd-b5cd-4bf4d1d22e1b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:20 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9815da2-1aef-4e74-b6aa-fdec8f492021]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuWVhOZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26638373230646533', 'path': '/dev/sdi'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638373230646533', 'path': '/dev/sdi'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:ff,bridge_name='br-int',has_traffic_filtering=True,id=3a371ba7-fd54-4cad-8a82-230fcddc7baf,network=Network(6289f056-40bc-4716-b888-f158fb387476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a371ba7-fd') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f3bb6d7-0b') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:2f,bridge_name='br-int',has_traffic_filtering=True,id=53e1bac0-1951-49d1-9086-7c35a689302a,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53e1bac0-19') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:70,bridge_name='br-int',has_traffic_filtering=True,id=1c415635-1c86-40b7-b0fb-9e2d3a59f99c,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c415635-1c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=9561b356-3304-4c7e-a845-24f13ad20859,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9561b356-33') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:df,bridge_name='br-int',has_traffic_filtering=True,id=8ecedd0d-0cb3-496c-a244-ddd03b914c72,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ecedd0d-0c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:de:2d,bridge_name='br-int',has_traffic_filtering=True,id=ba10ed3b-572a-4460-a5e5-597cd6dcd6af,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba10ed3b-57') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.objects.instance [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lazy-loading 'pci_devices' on Instance uuid ed711b9c-3bfc-41c9-8a33-725ffa363a56 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:36:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:36:21 user nova-compute[74241]:   <uuid>ed711b9c-3bfc-41c9-8a33-725ffa363a56</uuid>
Oct 20 11:36:21 user nova-compute[74241]:   <name>instance-0000000a</name>
Oct 20 11:36:21 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:36:21 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:36:21 user nova-compute[74241]:   <metadata>
Oct 20 11:36:21 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:36:21 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:36:21 user nova-compute[74241]:       <nova:name>tempest-device-tagging-server-962276620</nova:name>
Oct 20 11:36:21 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:36:17</nova:creationTime>
Oct 20 11:36:21 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:36:21 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:36:21 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:36:21 user nova-compute[74241]:       <nova:owner>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:user uuid="970b3107655b46128fb25719517d79e0">tempest-TaggedBootDevicesTest_v242-31976696-project-member</nova:user>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:project uuid="4d848adbb2a240649bfd1f2da652cdc6">tempest-TaggedBootDevicesTest_v242-31976696</nova:project>
Oct 20 11:36:21 user nova-compute[74241]:       </nova:owner>
Oct 20 11:36:21 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:36:21 user nova-compute[74241]:       <nova:ports>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:port uuid="3a371ba7-fd54-4cad-8a82-230fcddc7baf">
Oct 20 11:36:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 11:36:21 user nova-compute[74241]:         </nova:port>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:port uuid="2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec">
Oct 20 11:36:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.1.1.206" ipVersion="4"/>
Oct 20 11:36:21 user nova-compute[74241]:         </nova:port>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:port uuid="53e1bac0-1951-49d1-9086-7c35a689302a">
Oct 20 11:36:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.1.1.180" ipVersion="4"/>
Oct 20 11:36:21 user nova-compute[74241]:         </nova:port>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:port uuid="1c415635-1c86-40b7-b0fb-9e2d3a59f99c">
Oct 20 11:36:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Oct 20 11:36:21 user nova-compute[74241]:         </nova:port>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:port uuid="9561b356-3304-4c7e-a845-24f13ad20859">
Oct 20 11:36:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Oct 20 11:36:21 user nova-compute[74241]:         </nova:port>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:port uuid="8ecedd0d-0cb3-496c-a244-ddd03b914c72">
Oct 20 11:36:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 11:36:21 user nova-compute[74241]:         </nova:port>
Oct 20 11:36:21 user nova-compute[74241]:         <nova:port uuid="ba10ed3b-572a-4460-a5e5-597cd6dcd6af">
Oct 20 11:36:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 11:36:21 user nova-compute[74241]:         </nova:port>
Oct 20 11:36:21 user nova-compute[74241]:       </nova:ports>
Oct 20 11:36:21 user nova-compute[74241]:     </nova:instance>
Oct 20 11:36:21 user nova-compute[74241]:   </metadata>
Oct 20 11:36:21 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:36:21 user nova-compute[74241]:     <system>
Oct 20 11:36:21 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:36:21 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:36:21 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:36:21 user nova-compute[74241]:       <entry name="serial">ed711b9c-3bfc-41c9-8a33-725ffa363a56</entry>
Oct 20 11:36:21 user nova-compute[74241]:       <entry name="uuid">ed711b9c-3bfc-41c9-8a33-725ffa363a56</entry>
Oct 20 11:36:21 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:36:21 user nova-compute[74241]:     </system>
Oct 20 11:36:21 user nova-compute[74241]:   </sysinfo>
Oct 20 11:36:21 user nova-compute[74241]:   <os>
Oct 20 11:36:21 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:36:21 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:36:21 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:36:21 user nova-compute[74241]:   </os>
Oct 20 11:36:21 user nova-compute[74241]:   <features>
Oct 20 11:36:21 user nova-compute[74241]:     <acpi/>
Oct 20 11:36:21 user nova-compute[74241]:     <apic/>
Oct 20 11:36:21 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:36:21 user nova-compute[74241]:   </features>
Oct 20 11:36:21 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:36:21 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:36:21 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:36:21 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:36:21 user nova-compute[74241]:   </clock>
Oct 20 11:36:21 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:36:21 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:36:21 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:36:21 user nova-compute[74241]:   </cpu>
Oct 20 11:36:21 user nova-compute[74241]:   <devices>
Oct 20 11:36:21 user nova-compute[74241]:     <disk type="file" device="cdrom">
Oct 20 11:36:21 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 11:36:21 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/ed711b9c-3bfc-41c9-8a33-725ffa363a56/disk.config"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="hda" bus="ide"/>
Oct 20 11:36:21 user nova-compute[74241]:     </disk>
Oct 20 11:36:21 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:36:21 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:21 user nova-compute[74241]:       <source dev="/dev/sdg"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <serial>7f25239d-075d-415a-941b-923bad8a992d</serial>
Oct 20 11:36:21 user nova-compute[74241]:     </disk>
Oct 20 11:36:21 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:36:21 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:21 user nova-compute[74241]:       <source dev="/dev/sdh"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <serial>3a9000a6-adfc-4e05-9536-717f628c2fb1</serial>
Oct 20 11:36:21 user nova-compute[74241]:     </disk>
Oct 20 11:36:21 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:36:21 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:21 user nova-compute[74241]:       <source dev="/dev/sdi"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="vdc" bus="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <serial>917c1204-4581-40b2-95aa-628068e87e6e</serial>
Oct 20 11:36:21 user nova-compute[74241]:     </disk>
Oct 20 11:36:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:36:21 user nova-compute[74241]:       <mac address="fa:16:3e:1c:34:ff"/>
Oct 20 11:36:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="tap3a371ba7-fd"/>
Oct 20 11:36:21 user nova-compute[74241]:     </interface>
Oct 20 11:36:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:36:21 user nova-compute[74241]:       <mac address="fa:16:3e:3f:74:a5"/>
Oct 20 11:36:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="tap2f3bb6d7-0b"/>
Oct 20 11:36:21 user nova-compute[74241]:     </interface>
Oct 20 11:36:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:36:21 user nova-compute[74241]:       <mac address="fa:16:3e:7c:07:2f"/>
Oct 20 11:36:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="tap53e1bac0-19"/>
Oct 20 11:36:21 user nova-compute[74241]:     </interface>
Oct 20 11:36:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:36:21 user nova-compute[74241]:       <mac address="fa:16:3e:0a:fd:70"/>
Oct 20 11:36:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="tap1c415635-1c"/>
Oct 20 11:36:21 user nova-compute[74241]:     </interface>
Oct 20 11:36:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:36:21 user nova-compute[74241]:       <mac address="fa:16:3e:16:81:9e"/>
Oct 20 11:36:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="tap9561b356-33"/>
Oct 20 11:36:21 user nova-compute[74241]:     </interface>
Oct 20 11:36:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:36:21 user nova-compute[74241]:       <mac address="fa:16:3e:76:7e:df"/>
Oct 20 11:36:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="tap8ecedd0d-0c"/>
Oct 20 11:36:21 user nova-compute[74241]:     </interface>
Oct 20 11:36:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:36:21 user nova-compute[74241]:       <mac address="fa:16:3e:e5:de:2d"/>
Oct 20 11:36:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:36:21 user nova-compute[74241]:       <target dev="tapba10ed3b-57"/>
Oct 20 11:36:21 user nova-compute[74241]:     </interface>
Oct 20 11:36:21 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:36:21 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/ed711b9c-3bfc-41c9-8a33-725ffa363a56/console.log" append="off"/>
Oct 20 11:36:21 user nova-compute[74241]:     </serial>
Oct 20 11:36:21 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:36:21 user nova-compute[74241]:     <video>
Oct 20 11:36:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:36:21 user nova-compute[74241]:     </video>
Oct 20 11:36:21 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:36:21 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:36:21 user nova-compute[74241]:     </rng>
Oct 20 11:36:21 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:36:21 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:36:21 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:36:21 user nova-compute[74241]:     </memballoon>
Oct 20 11:36:21 user nova-compute[74241]:   </devices>
Oct 20 11:36:21 user nova-compute[74241]: </domain>
Oct 20 11:36:21 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:ff,bridge_name='br-int',has_traffic_filtering=True,id=3a371ba7-fd54-4cad-8a82-230fcddc7baf,network=Network(6289f056-40bc-4716-b888-f158fb387476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a371ba7-fd') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:ff,bridge_name='br-int',has_traffic_filtering=True,id=3a371ba7-fd54-4cad-8a82-230fcddc7baf,network=Network(6289f056-40bc-4716-b888-f158fb387476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a371ba7-fd') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65fd0200-3500-5c16-a9fe-bba4f109e0c4', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a371ba7-fd, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a371ba7-fd, col_values=(('qos', UUID('3acfbba7-efef-48bb-b06e-62ae24b7fb07')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a371ba7-fd, col_values=(('external_ids', {'iface-id': '3a371ba7-fd54-4cad-8a82-230fcddc7baf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:34:ff', 'vm-uuid': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: INFO os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:34:ff,bridge_name='br-int',has_traffic_filtering=True,id=3a371ba7-fd54-4cad-8a82-230fcddc7baf,network=Network(6289f056-40bc-4716-b888-f158fb387476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a371ba7-fd')
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f3bb6d7-0b') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f3bb6d7-0b') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6368d9e-3dda-5f19-a751-96a967741735', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f3bb6d7-0b, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f3bb6d7-0b, col_values=(('qos', UUID('97f7d6f8-b84f-45a1-8807-fe72beb5568d')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f3bb6d7-0b, col_values=(('external_ids', {'iface-id': '2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:74:a5', 'vm-uuid': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: INFO os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f3bb6d7-0b')
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:2f,bridge_name='br-int',has_traffic_filtering=True,id=53e1bac0-1951-49d1-9086-7c35a689302a,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53e1bac0-19') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:2f,bridge_name='br-int',has_traffic_filtering=True,id=53e1bac0-1951-49d1-9086-7c35a689302a,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53e1bac0-19') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de665d15-690b-5246-965c-ec346c6b2856', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53e1bac0-19, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53e1bac0-19, col_values=(('qos', UUID('cfee8699-d4e0-4f0c-a489-b7e890dd1eaa')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53e1bac0-19, col_values=(('external_ids', {'iface-id': '53e1bac0-1951-49d1-9086-7c35a689302a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:07:2f', 'vm-uuid': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: INFO os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:2f,bridge_name='br-int',has_traffic_filtering=True,id=53e1bac0-1951-49d1-9086-7c35a689302a,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53e1bac0-19')
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:70,bridge_name='br-int',has_traffic_filtering=True,id=1c415635-1c86-40b7-b0fb-9e2d3a59f99c,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c415635-1c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:70,bridge_name='br-int',has_traffic_filtering=True,id=1c415635-1c86-40b7-b0fb-9e2d3a59f99c,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c415635-1c') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24beb7eb-ddc6-584d-8b01-b5e53ac4cfbc', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c415635-1c, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c415635-1c, col_values=(('qos', UUID('6459a516-c0f3-45d5-9a45-a1706112ba7c')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c415635-1c, col_values=(('external_ids', {'iface-id': '1c415635-1c86-40b7-b0fb-9e2d3a59f99c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:fd:70', 'vm-uuid': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: INFO os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:70,bridge_name='br-int',has_traffic_filtering=True,id=1c415635-1c86-40b7-b0fb-9e2d3a59f99c,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c415635-1c')
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=9561b356-3304-4c7e-a845-24f13ad20859,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9561b356-33') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=9561b356-3304-4c7e-a845-24f13ad20859,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9561b356-33') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a082ce78-e129-5da3-8db5-68240a588bf4', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9561b356-33, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9561b356-33, col_values=(('qos', UUID('0093b193-5a33-4540-8774-c2473b6cda87')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9561b356-33, col_values=(('external_ids', {'iface-id': '9561b356-3304-4c7e-a845-24f13ad20859', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:81:9e', 'vm-uuid': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: INFO os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=9561b356-3304-4c7e-a845-24f13ad20859,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9561b356-33')
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:df,bridge_name='br-int',has_traffic_filtering=True,id=8ecedd0d-0cb3-496c-a244-ddd03b914c72,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ecedd0d-0c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:df,bridge_name='br-int',has_traffic_filtering=True,id=8ecedd0d-0cb3-496c-a244-ddd03b914c72,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ecedd0d-0c') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3bcf2d95-cb3f-5f6a-9280-cee3e6ce9468', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ecedd0d-0c, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ecedd0d-0c, col_values=(('qos', UUID('ad2c0d3e-cc1e-46f9-a9ba-78268163795b')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ecedd0d-0c, col_values=(('external_ids', {'iface-id': '8ecedd0d-0cb3-496c-a244-ddd03b914c72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:7e:df', 'vm-uuid': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: INFO os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:df,bridge_name='br-int',has_traffic_filtering=True,id=8ecedd0d-0cb3-496c-a244-ddd03b914c72,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ecedd0d-0c')
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:de:2d,bridge_name='br-int',has_traffic_filtering=True,id=ba10ed3b-572a-4460-a5e5-597cd6dcd6af,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba10ed3b-57') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:de:2d,bridge_name='br-int',has_traffic_filtering=True,id=ba10ed3b-572a-4460-a5e5-597cd6dcd6af,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba10ed3b-57') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc064206-53ac-5fae-b5c8-5cca002b49f0', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba10ed3b-57, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba10ed3b-57, col_values=(('qos', UUID('f4745296-860e-40aa-8784-9a43175d978d')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba10ed3b-57, col_values=(('external_ids', {'iface-id': 'ba10ed3b-572a-4460-a5e5-597cd6dcd6af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:de:2d', 'vm-uuid': 'ed711b9c-3bfc-41c9-8a33-725ffa363a56'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:22 user nova-compute[74241]: INFO os_vif [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:de:2d,bridge_name='br-int',has_traffic_filtering=True,id=ba10ed3b-572a-4460-a5e5-597cd6dcd6af,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba10ed3b-57')
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] No BDM found with device name hda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] No VIF found with MAC fa:16:3e:1c:34:ff, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] No VIF found with MAC fa:16:3e:16:81:9e, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:36:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Using config drive
Oct 20 11:36:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Creating config drive at /opt/stack/data/nova/instances/ed711b9c-3bfc-41c9-8a33-725ffa363a56/disk.config
Oct 20 11:36:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ed711b9c-3bfc-41c9-8a33-725ffa363a56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6vge7nvn {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ed711b9c-3bfc-41c9-8a33-725ffa363a56/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp6vge7nvn" returned: 0 in 0.052s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-8937be2b-5e75-4661-8351-ff0fc4e7ad85 req-f93dde1f-1a2a-4d77-b14e-191266bc0ed9 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8937be2b-5e75-4661-8351-ff0fc4e7ad85 req-f93dde1f-1a2a-4d77-b14e-191266bc0ed9 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8937be2b-5e75-4661-8351-ff0fc4e7ad85 req-f93dde1f-1a2a-4d77-b14e-191266bc0ed9 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8937be2b-5e75-4661-8351-ff0fc4e7ad85 req-f93dde1f-1a2a-4d77-b14e-191266bc0ed9 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-8937be2b-5e75-4661-8351-ff0fc4e7ad85 req-f93dde1f-1a2a-4d77-b14e-191266bc0ed9 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:24 user nova-compute[74241]: WARNING nova.compute.manager [req-8937be2b-5e75-4661-8351-ff0fc4e7ad85 req-f93dde1f-1a2a-4d77-b14e-191266bc0ed9 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf for instance with vm_state building and task_state spawning.
Oct 20 11:36:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-cccf3fd7-3043-4668-9f82-a3667063844e req-78146b99-8f69-4391-85fb-a8955a813db7 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cccf3fd7-3043-4668-9f82-a3667063844e req-78146b99-8f69-4391-85fb-a8955a813db7 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cccf3fd7-3043-4668-9f82-a3667063844e req-78146b99-8f69-4391-85fb-a8955a813db7 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cccf3fd7-3043-4668-9f82-a3667063844e req-78146b99-8f69-4391-85fb-a8955a813db7 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-cccf3fd7-3043-4668-9f82-a3667063844e req-78146b99-8f69-4391-85fb-a8955a813db7 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:25 user nova-compute[74241]: WARNING nova.compute.manager [req-cccf3fd7-3043-4668-9f82-a3667063844e req-78146b99-8f69-4391-85fb-a8955a813db7 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec for instance with vm_state building and task_state spawning.
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-04238336-51e2-42d5-acb4-2f27eba0c549 req-36d30905-77b8-4a90-9aea-43edb6c60db1 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-04238336-51e2-42d5-acb4-2f27eba0c549 req-36d30905-77b8-4a90-9aea-43edb6c60db1 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-04238336-51e2-42d5-acb4-2f27eba0c549 req-36d30905-77b8-4a90-9aea-43edb6c60db1 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-04238336-51e2-42d5-acb4-2f27eba0c549 req-36d30905-77b8-4a90-9aea-43edb6c60db1 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-04238336-51e2-42d5-acb4-2f27eba0c549 req-36d30905-77b8-4a90-9aea-43edb6c60db1 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:25 user nova-compute[74241]: WARNING nova.compute.manager [req-04238336-51e2-42d5-acb4-2f27eba0c549 req-36d30905-77b8-4a90-9aea-43edb6c60db1 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c for instance with vm_state building and task_state spawning.
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:26 user nova-compute[74241]: WARNING nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf for instance with vm_state building and task_state spawning.
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:26 user nova-compute[74241]: WARNING nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a for instance with vm_state building and task_state spawning.
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:26 user nova-compute[74241]: WARNING nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a for instance with vm_state building and task_state spawning.
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:26 user nova-compute[74241]: WARNING nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 for instance with vm_state building and task_state spawning.
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:26 user nova-compute[74241]: WARNING nova.compute.manager [req-1e9837af-0070-476a-9e8a-00f19ff11e20 req-3684b508-67f5-411a-bdac-44279f74f87f service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 for instance with vm_state building and task_state spawning.
Oct 20 11:36:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-dba99b81-244b-473f-a505-9c8778257de4 req-1142c7f5-d922-4024-b634-700b5c0bc630 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-dba99b81-244b-473f-a505-9c8778257de4 req-1142c7f5-d922-4024-b634-700b5c0bc630 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-dba99b81-244b-473f-a505-9c8778257de4 req-1142c7f5-d922-4024-b634-700b5c0bc630 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-dba99b81-244b-473f-a505-9c8778257de4 req-1142c7f5-d922-4024-b634-700b5c0bc630 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-dba99b81-244b-473f-a505-9c8778257de4 req-1142c7f5-d922-4024-b634-700b5c0bc630 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:27 user nova-compute[74241]: WARNING nova.compute.manager [req-dba99b81-244b-473f-a505-9c8778257de4 req-1142c7f5-d922-4024-b634-700b5c0bc630 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec for instance with vm_state building and task_state spawning.
Oct 20 11:36:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:27 user nova-compute[74241]: WARNING nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c for instance with vm_state building and task_state spawning.
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:27 user nova-compute[74241]: WARNING nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 for instance with vm_state building and task_state spawning.
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:27 user nova-compute[74241]: WARNING nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 for instance with vm_state building and task_state spawning.
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:27 user nova-compute[74241]: WARNING nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af for instance with vm_state building and task_state spawning.
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:27 user nova-compute[74241]: WARNING nova.compute.manager [req-2c07420e-7d4c-42bf-98b6-48bc7f6ae7fd req-1dbf2068-8efd-4279-8ca8-80e081e14c83 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af for instance with vm_state building and task_state spawning.
Oct 20 11:36:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:36:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance spawned successfully.
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:36:28 user nova-compute[74241]: INFO nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Took 11.82 seconds to spawn the instance on the hypervisor.
Oct 20 11:36:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:36:29 user nova-compute[74241]: INFO nova.compute.manager [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Took 114.41 seconds to build instance.
Oct 20 11:36:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-952571ac-a82c-40b0-bf82-0d46bbdb7f92 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 114.515s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:36:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnegUxwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:34 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:34 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:34 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:36:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69b5696-9352-4d16-ba26-e2351f7110db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:36:34 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3cea83-bd47-4e84-9c15-c298e4363cee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae] added
Oct 20 11:36:35 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da7e851-c291-46cc-a26c-e86312505757]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35a98ac-031d-4dec-925c-e42d645d8156]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnegUxwS {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AnegUxwS" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46850ff-a518-40b8-88e7-b5e5a26de5ec]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AnegUxwS'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e780f0-815d-422e-959d-e537954e92fe]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30255b8-e5cd-4b2e-9b2c-5d2f4e326728]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:35 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:35 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[29650793-c72d-447d-b1c4-47d0b3416865]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae, portal: 172.16.0.220,3260]
Oct 20 11:36:35 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:35 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f915e07-0eb5-44df-8b00-681643ee5c71]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1b2277-ef70-49f6-90c0-720bb437bde7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:35 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:35 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:35 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf2a9af-b55a-49de-b41c-51524bae3db8]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnegUxwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2be424f9-e44b-4f2b-a5ce-187b5602ca27 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.734s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:35 user nova-compute[74241]: INFO nova.compute.manager [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Rebuilding instance
Oct 20 11:36:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:35 user nova-compute[74241]: INFO nova.compute.manager [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Terminating instance
Oct 20 11:36:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-16faf0ea-a9b8-4cda-ae2f-7673cc5581f0 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] volume_snapshot_create: create_info: {'snapshot_id': '17922869-366a-4b83-8f82-79036cbf5645', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74241) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-16faf0ea-a9b8-4cda-ae2f-7673cc5581f0 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] snap xml: <domainsnapshot>
Oct 20 11:36:36 user nova-compute[74241]:   <disks>
Oct 20 11:36:36 user nova-compute[74241]:     <disk name="/dev/sde" snapshot="external" type="file">
Oct 20 11:36:36 user nova-compute[74241]:       <source file="/dev/new_file"/>
Oct 20 11:36:36 user nova-compute[74241]:     </disk>
Oct 20 11:36:36 user nova-compute[74241]:     <disk name="vda" snapshot="no"/>
Oct 20 11:36:36 user nova-compute[74241]:   </disks>
Oct 20 11:36:36 user nova-compute[74241]: </domainsnapshot>
Oct 20 11:36:36 user nova-compute[74241]:  {{(pid=74241) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.objects.instance [None req-16faf0ea-a9b8-4cda-ae2f-7673cc5581f0 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] Lazy-loading 'system_metadata' on Instance uuid 9f326446-5aa8-47f0-bc97-0f2c9664319f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2b0ec4cc-661b-4b86-8060-1d695576cc53 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] volume_snapshot_delete: delete_info: {'volume_id': 'fe3b99c1-eb07-48d8-840e-9fd6b90cf514'} {{(pid=74241) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [None req-2b0ec4cc-661b-4b86-8060-1d695576cc53 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     if delete_info['type'] != 'qcow2':
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] KeyError: 'type'
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] 
Oct 20 11:36:36 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-16faf0ea-a9b8-4cda-ae2f-7673cc5581f0 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [None req-16faf0ea-a9b8-4cda-ae2f-7673cc5581f0 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     rv = execute(f, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     six.reraise(c, e, tb)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     raise value
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     rv = meth(*args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [None req-16faf0ea-a9b8-4cda-ae2f-7673cc5581f0 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     self._volume_snapshot_create(context, instance, guest,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     rv = execute(f, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     six.reraise(c, e, tb)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     raise value
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     rv = meth(*args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] 
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26131363137383034', 'path': '/dev/sdj'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131363137383034', 'path': '/dev/sdj'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.objects.instance [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lazy-loading 'flavor' on Instance uuid 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-36422026-1cc8-4e6a-876a-231d59598b49 req-1b3217ae-4705-468f-9d2e-f82e0e7598c2 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-unplugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-36422026-1cc8-4e6a-876a-231d59598b49 req-1b3217ae-4705-468f-9d2e-f82e0e7598c2 service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-36422026-1cc8-4e6a-876a-231d59598b49 req-1b3217ae-4705-468f-9d2e-f82e0e7598c2 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-36422026-1cc8-4e6a-876a-231d59598b49 req-1b3217ae-4705-468f-9d2e-f82e0e7598c2 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-36422026-1cc8-4e6a-876a-231d59598b49 req-1b3217ae-4705-468f-9d2e-f82e0e7598c2 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] No waiting events found dispatching network-vif-unplugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:36 user nova-compute[74241]: WARNING nova.compute.manager [req-36422026-1cc8-4e6a-876a-231d59598b49 req-1b3217ae-4705-468f-9d2e-f82e0e7598c2 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received unexpected event network-vif-unplugged-f3ee0369-7aca-4c21-8798-c9158cc47bec for instance with vm_state active and task_state rebuilding.
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-07ed1641-a6e6-428a-b23a-e7aec77628ea req-5a9807d0-320c-4c90-ae83-6f11e146671a service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received event network-vif-unplugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-07ed1641-a6e6-428a-b23a-e7aec77628ea req-5a9807d0-320c-4c90-ae83-6f11e146671a service nova] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-07ed1641-a6e6-428a-b23a-e7aec77628ea req-5a9807d0-320c-4c90-ae83-6f11e146671a service nova] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-07ed1641-a6e6-428a-b23a-e7aec77628ea req-5a9807d0-320c-4c90-ae83-6f11e146671a service nova] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-07ed1641-a6e6-428a-b23a-e7aec77628ea req-5a9807d0-320c-4c90-ae83-6f11e146671a service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] No waiting events found dispatching network-vif-unplugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-07ed1641-a6e6-428a-b23a-e7aec77628ea req-5a9807d0-320c-4c90-ae83-6f11e146671a service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received event network-vif-unplugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [None req-2b0ec4cc-661b-4b86-8060-1d695576cc53 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-8204135e-5a86-480e-94e9-de9996075b1a)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:36:36 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:36 user nova-compute[74241]:   <source dev="/dev/sdj"/>
Oct 20 11:36:36 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:36 user nova-compute[74241]:   <serial>127f3bca-0e69-48b2-9f07-1c60fb9f79ae</serial>
Oct 20 11:36:36 user nova-compute[74241]: </disk>
Oct 20 11:36:36 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_brick.utils [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server [None req-2b0ec4cc-661b-4b86-8060-1d695576cc53 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] Exception during message handling: KeyError: 'type'
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server 
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f54ff2-8035-4822-9b6e-a995947d0a0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39076e8-8898-4d69-b5e5-ac27802cfcab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d86275-1fe9-4fae-83b1-b17bc8b72cc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fe7646-6029-48e9-97e6-e35d225423a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:36:36 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:36:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2442a50-7e80-4f1e-83ea-026d27df27fb]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_brick.utils [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver [None req-16faf0ea-a9b8-4cda-ae2f-7673cc5581f0 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 17922869-366a-4b83-8f82-79036cbf5645 could not be found.
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     raise value
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 17922869-366a-4b83-8f82-79036cbf5645 could not be found. (HTTP 404) (Request-ID: req-a2b34748-c21d-4609-b48e-238ff220fc5f)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 17922869-366a-4b83-8f82-79036cbf5645 could not be found.
Oct 20 11:36:36 user nova-compute[74241]: ERROR nova.virt.libvirt.driver 
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server [None req-16faf0ea-a9b8-4cda-ae2f-7673cc5581f0 tempest-VolumesAssistedSnapshotsTest-726307518 tempest-VolumesAssistedSnapshotsTest-726307518-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     raise value
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 11:36:36 user nova-compute[74241]: ERROR oslo_messaging.rpc.server 
Oct 20 11:36:36 user nova-compute[74241]: INFO nova.compute.manager [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Swapping volume c2ef804d-dc18-47c8-9809-8a29ea62bdbc for 5c6c6907-ef85-41f4-a42e-7e7792f2c612
Oct 20 11:36:36 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Instance destroyed successfully.
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.objects.instance [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lazy-loading 'resources' on Instance uuid 6a1b5fb2-449e-4648-8dc0-276813417b1d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-622124846',display_name='tempest-DeleteServersTestJSON-server-622124846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-622124846',id=1,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='098fd658c3ab4b8dbec2354e04e50f26',ramdisk_id='',reservation_id='r-4ucgk79m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-263461688',owner_user_name='tempest-DeleteServersTestJSON-263461688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:11Z,user_data=None,user_id='d34d3bc237674577b870c03fe516a84d',uuid=6a1b5fb2-449e-4648-8dc0-276813417b1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Converting VIF {"id": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "address": "fa:16:3e:b2:e5:2b", "network": {"id": "0d3f4b36-5087-4b22-8beb-9cc2f6d4638b", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-2126556702-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098fd658c3ab4b8dbec2354e04e50f26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4136cb20-f5", "ovs_interfaceid": "4136cb20-f54d-4fd3-ba90-5b4fc294778a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=4136cb20-f54d-4fd3-ba90-5b4fc294778a,network=Network(0d3f4b36-5087-4b22-8beb-9cc2f6d4638b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136cb20-f5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG os_vif [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=4136cb20-f54d-4fd3-ba90-5b4fc294778a,network=Network(0d3f4b36-5087-4b22-8beb-9cc2f6d4638b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136cb20-f5') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4136cb20-f5, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3bcfac62-5b9c-43b2-8c84-d8bf768fadb9) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] No VIF found with MAC fa:16:3e:93:53:8b, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:36:37 user nova-compute[74241]: INFO os_vif [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e5:2b,bridge_name='br-int',has_traffic_filtering=True,id=4136cb20-f54d-4fd3-ba90-5b4fc294778a,network=Network(0d3f4b36-5087-4b22-8beb-9cc2f6d4638b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4136cb20-f5')
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RKFXUVnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:37 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d68a5a-f9f7-4d0b-a8f4-d39197e1bce7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:36:37 user nova-compute[74241]: No targets found.
Oct 20 11:36:37 user nova-compute[74241]: iSNS:
Oct 20 11:36:37 user nova-compute[74241]: No targets found.
Oct 20 11:36:37 user nova-compute[74241]: STATIC:
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: FIRMWARE:
Oct 20 11:36:37 user nova-compute[74241]: No targets found.
Oct 20 11:36:37 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:36:37 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:36:37 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7e94f0-74e2-42dc-9d68-12b16189e400]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d15940b-315e-4cd5-8394-971f70ac92b1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:37 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:37 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5228377910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb09e9d3-3ef5-42bd-9808-d3ca55659dbd]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5312b3-ca89-4519-b2e0-d309f9336b26]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[910e0d94-eac6-4c10-9384-bb3905815a9c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance destroyed successfully.
Oct 20 11:36:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance destroyed successfully.
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1119991789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1295570451',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaUIsowPmm/MBl/9oF/rCt+woqma1ayrQNEAD67yYMwRXAZ/8sIsCOKQwamQdDx/t/+9n1SuwVQPPyBfK/H1EhTaY9NImQ0KPlZ9u0wdeUyzHwRbNbIGnoy7DD6297w1w==',key_name='tempest-keypair-1421120003',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c453ef58eb74b0d9ae83d020931ff83',ramdisk_id='',reservation_id='r-s8k6ynmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1927240912',owner_user_name='tempest-ServerActionsV293TestJSON-1927240912-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfbfcb932abf47388e416266cd2f1098',uuid=34e3ad13-abe7-4167-9d8c-474f59397b6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converting VIF {"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_vif [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3ee0369-7a, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d956548-9749-403b-baaa-7dd72004ff36) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:37 user nova-compute[74241]: INFO os_vif [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a')
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:37 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.148s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b443442-e907-48b7-acb6-c924a05608ea]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23061386233356537', '/dev/disk/by-id/scsi-1SCST_BIO3f885796-0a8b35e72ef73b77', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3f885796') {{(pid=85185) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3281c74-b365-4c9d-bcda-54b553b7534e]: (4, None) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f2c946-407c-4722-914a-d6a4c4af2ef5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb926747-998d-47f0-a1de-16d33a73b472]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378, portal: 172.16.0.220,3260]
Oct 20 11:36:37 user nova-compute[74241]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:37 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7e3a4de-1a57-4b9d-b9c3-450e32149378 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6752e74-8393-48d4-a307-ebfa8601afad]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.505s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] <== disconnect_volume: return (506ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:36:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Deleting instance files /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d_del
Oct 20 11:36:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Deletion of /opt/stack/data/nova/instances/6a1b5fb2-449e-4648-8dc0-276813417b1d_del complete
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.246s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8174e9fe-a70d-427b-adf7-57acb02407dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:36:37 user nova-compute[74241]: No targets found.
Oct 20 11:36:37 user nova-compute[74241]: iSNS:
Oct 20 11:36:37 user nova-compute[74241]: No targets found.
Oct 20 11:36:37 user nova-compute[74241]: STATIC:
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:36:37 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:36:37 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:36:37 user nova-compute[74241]: FIRMWARE:
Oct 20 11:36:37 user nova-compute[74241]: No targets found.
Oct 20 11:36:37 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:36:37 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:36:37 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[036b217a-0091-4cb1-95e6-670c91b94628]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: INFO nova.compute.manager [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Took 1.79 seconds to destroy the instance on the hypervisor.
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff70386a-45c9-4555-9d9a-abfc63e0a245]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:37 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:37 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:37 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f520879d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5468e64-5a92-4f05-83e0-9e06aba559ff]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[73553e23-ca45-4408-8f85-99a62388b4c9]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f8541f-dcfe-4abc-808b-1ec2c26bf240]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5615871c-4979-4cb1-8aa0-e1088c581efa]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5755f3-7e15-46a0-8a94-7cbf1c42cd44]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f830925d-7e0d-4bf6-9507-1f70da0111ce]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260]
Oct 20 11:36:37 user nova-compute[74241]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:37 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f37ffbf-27a9-48f7-9c7c-c7fd3f119563]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] <== disconnect_volume: return (638ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:36:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Deleting instance files /opt/stack/data/nova/instances/34e3ad13-abe7-4167-9d8c-474f59397b6e_del
Oct 20 11:36:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Deletion of /opt/stack/data/nova/instances/34e3ad13-abe7-4167-9d8c-474f59397b6e_del complete
Oct 20 11:36:38 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:36:38 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Took 0.69 seconds to deallocate network for instance.
Oct 20 11:36:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-3efcc81c-fd39-4f49-9466-34f9b04cd5f7 req-ac825e63-b68e-4412-a840-4f7d11a4596a service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received event network-vif-deleted-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-d54bb661-9068-4285-9809-5c0355ca8113 req-ec452678-6699-43e9-8260-168e51d95dd9 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d54bb661-9068-4285-9809-5c0355ca8113 req-ec452678-6699-43e9-8260-168e51d95dd9 service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d54bb661-9068-4285-9809-5c0355ca8113 req-ec452678-6699-43e9-8260-168e51d95dd9 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d54bb661-9068-4285-9809-5c0355ca8113 req-ec452678-6699-43e9-8260-168e51d95dd9 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-d54bb661-9068-4285-9809-5c0355ca8113 req-ec452678-6699-43e9-8260-168e51d95dd9 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] No waiting events found dispatching network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:38 user nova-compute[74241]: WARNING nova.compute.manager [req-d54bb661-9068-4285-9809-5c0355ca8113 req-ec452678-6699-43e9-8260-168e51d95dd9 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received unexpected event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec for instance with vm_state active and task_state rebuilding.
Oct 20 11:36:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-7a523c6c-1671-48e3-90a1-b642b4ff480c req-7aacfc89-3729-4a05-8418-bd7d5af911e0 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received event network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7a523c6c-1671-48e3-90a1-b642b4ff480c req-7aacfc89-3729-4a05-8418-bd7d5af911e0 service nova] Acquiring lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7a523c6c-1671-48e3-90a1-b642b4ff480c req-7aacfc89-3729-4a05-8418-bd7d5af911e0 service nova] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7a523c6c-1671-48e3-90a1-b642b4ff480c req-7aacfc89-3729-4a05-8418-bd7d5af911e0 service nova] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-7a523c6c-1671-48e3-90a1-b642b4ff480c req-7aacfc89-3729-4a05-8418-bd7d5af911e0 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] No waiting events found dispatching network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:36:38 user nova-compute[74241]: WARNING nova.compute.manager [req-7a523c6c-1671-48e3-90a1-b642b4ff480c req-7aacfc89-3729-4a05-8418-bd7d5af911e0 service nova] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Received unexpected event network-vif-plugged-4136cb20-f54d-4fd3-ba90-5b4fc294778a for instance with vm_state active and task_state deleting.
Oct 20 11:36:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:36:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:47 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:36:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:36:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7930MB free_disk=25.587692260742188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6a1b5fb2-449e-4648-8dc0-276813417b1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d128bb7d-42b2-4d1a-94c0-de749ec2235c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9f326446-5aa8-47f0-bc97-0f2c9664319f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 34e3ad13-abe7-4167-9d8c-474f59397b6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ed711b9c-3bfc-41c9-8a33-725ffa363a56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3c73caa8-a299-41e1-bd85-66299f6641f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:36:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:36:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:36:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:36:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:36:52 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updating instance_info_cache with network_info: [{"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:36:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:36:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:36:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:36:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:36:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDFHQnVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:57 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:57 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:57 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4de9ca-a522-4950-ade7-c59cca9d1a7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:36:57 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe0ce6a-c452-4106-8f07-59f000418646]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414] added
Oct 20 11:36:57 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: INFO nova.compute.manager [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Detaching volume fe3b99c1-eb07-48d8-840e-9fd6b90cf514
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55f58f6-dddd-4ca3-9019-8e6a74c3e94d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[85582c50-d7e5-4efc-b5be-20b9e8b69293]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MDFHQnVI {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MDFHQnVI" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7a9d1c-94a2-4b23-92b2-83e844e1cc40]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MDFHQnVI'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-22f517f6-88ec-4647-8d32-92ae6143af32 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 76.519s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea6e9fe-33d3-47e0-8db9-5a4721a31d8a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba5ea6c-2344-493e-90f2-5884329ec88b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:57 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:57 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akjTrJwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb', 'attached_at': '', 'detached_at': '', 'volume_id': '5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'serial': '5c6c6907-ef85-41f4-a42e-7e7792f2c612'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'serial'} {{(pid=74241) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akjTrJwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:57 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d493ee9-d0f2-4cb3-95d5-e365fa4604d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414, portal: 172.16.0.220,3260]
Oct 20 11:36:57 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:57 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1634f0e-b947-4c9b-ba5d-00385e603efd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: INFO nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Booting with volume b95c7213-9164-4ee2-8f50-221f7be5d965 at /dev/vdc
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a173348c-5558-4961-86ea-8fb3e811d320]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:57 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:57 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:57 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26e68fd-84f2-4051-85f8-ebcd3834ad2a]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDFHQnVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:57 user nova-compute[74241]: INFO nova.compute.manager [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Detaching volume 04e7867b-9132-40f0-8536-c0f807ccc13a
Oct 20 11:36:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 34e3ad13-abe7-4167-9d8c-474f59397b6e could not be found.
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:57 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.objects.instance [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'flavor' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:36:57 user nova-compute[74241]: INFO nova.virt.block_device [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Attempting to driver detach volume fe3b99c1-eb07-48d8-840e-9fd6b90cf514 from mountpoint /dev/vdb
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Attempting to detach device vdb from instance 9f326446-5aa8-47f0-bc97-0f2c9664319f from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 11:36:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:57 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:36:57 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:57 user nova-compute[74241]:   <serial>fe3b99c1-eb07-48d8-840e-9fd6b90cf514</serial>
Oct 20 11:36:57 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:36:57 user nova-compute[74241]: </disk>
Oct 20 11:36:57 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:57 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Successfully detached device vdb from instance 9f326446-5aa8-47f0-bc97-0f2c9664319f from the persistent domain config.
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9f326446-5aa8-47f0-bc97-0f2c9664319f from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 11:36:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:57 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:36:57 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:57 user nova-compute[74241]:   <serial>fe3b99c1-eb07-48d8-840e-9fd6b90cf514</serial>
Oct 20 11:36:57 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:36:57 user nova-compute[74241]: </disk>
Oct 20 11:36:57 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG os_brick.utils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[739436bc-2412-404f-ad93-9fbcacab11a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d832d3c-5085-48b3-9a7a-c2fcc960d0ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:57 user nova-compute[74241]: INFO nova.virt.block_device [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Attempting to driver detach volume 04e7867b-9132-40f0-8536-c0f807ccc13a from mountpoint /dev/vdb
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Attempting to detach device vdb from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:36:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:57 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 11:36:57 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:57 user nova-compute[74241]:   <serial>04e7867b-9132-40f0-8536-c0f807ccc13a</serial>
Oct 20 11:36:57 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 11:36:57 user nova-compute[74241]: </disk>
Oct 20 11:36:57 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:57 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3da8a5-52b1-4070-a4b4-4227b112b65d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[467a7472-93df-4f51-9b58-b64059f46e58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Successfully detached device vdb from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 from the persistent domain config.
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:36:58 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:58 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 11:36:58 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:58 user nova-compute[74241]:   <serial>04e7867b-9132-40f0-8536-c0f807ccc13a</serial>
Oct 20 11:36:58 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 11:36:58 user nova-compute[74241]: </disk>
Oct 20 11:36:58 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:36:58 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7796e4d-75cd-4622-bd1f-ce8483984a66]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.utils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating existing volume attachment record: 7988a50a-ce62-4e3c-9fb5-60b94ccf15e4 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:58 user nova-compute[74241]: INFO nova.compute.manager [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Attaching volume 55d0f928-afff-41a0-b970-021ed8f154b6 to /dev/vdb
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.utils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c288113-838f-499b-8ba7-892d8541ecd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec822f34-50d4-446a-ba30-086f11d75e5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd83adf0-4b34-4d97-bb87-00bca572440e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbc4665-14b4-4ab0-9636-c03bf32be281]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9f326446-5aa8-47f0-bc97-0f2c9664319f {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: INFO nova.compute.manager [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Detaching volume 127f3bca-0e69-48b2-9f07-1c60fb9f79ae
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:36:58 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c391eb1-b962-4689-b51a-e1cc198269c8]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.utils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating existing volume attachment record: 27bde60e-aece-457e-bf4c-33a16bb289f8 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:36:58 user nova-compute[74241]: INFO nova.compute.manager [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] [instance: 6a1b5fb2-449e-4648-8dc0-276813417b1d] Took 20.16 seconds to detach 1 volumes for instance.
Oct 20 11:36:58 user nova-compute[74241]: INFO nova.virt.block_device [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Attempting to driver detach volume 127f3bca-0e69-48b2-9f07-1c60fb9f79ae from mountpoint /dev/vdb
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Attempting to detach device vdb from instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:36:58 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:58 user nova-compute[74241]:   <source dev="/dev/sdj"/>
Oct 20 11:36:58 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:58 user nova-compute[74241]:   <serial>127f3bca-0e69-48b2-9f07-1c60fb9f79ae</serial>
Oct 20 11:36:58 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:36:58 user nova-compute[74241]: </disk>
Oct 20 11:36:58 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:36:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Successfully detached device vdb from instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d from the persistent domain config.
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:36:58 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:58 user nova-compute[74241]:   <source dev="/dev/sdj"/>
Oct 20 11:36:58 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:36:58 user nova-compute[74241]:   <serial>127f3bca-0e69-48b2-9f07-1c60fb9f79ae</serial>
Oct 20 11:36:58 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:36:58 user nova-compute[74241]: </disk>
Oct 20 11:36:58 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23333373463326337', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333373463326337', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.135s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:58 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:36:58 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lazy-loading 'flavor' on Instance uuid d128bb7d-42b2-4d1a-94c0-de749ec2235c {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e85b55-8827-4f4b-9f74-e6ee7e399f5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:36:58 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:36:58 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:36:58 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:36:58 user nova-compute[74241]:   <target dev="sdc" bus="scsi"/>
Oct 20 11:36:58 user nova-compute[74241]:   <serial>2fea6248-ed62-4bb6-b46b-6a891c1ad414</serial>
Oct 20 11:36:58 user nova-compute[74241]:   <address type="drive" controller="0" unit="2"/>
Oct 20 11:36:58 user nova-compute[74241]: </disk>
Oct 20 11:36:58 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a3ae6b-5266-4a77-a3c6-28b4ee51faef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612] added
Oct 20 11:36:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[968cc939-ad91-455e-bddc-06a38160c190]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffdae49-816f-4e18-b605-3f323219105e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akjTrJwG {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akjTrJwG" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd66fff-ccd7-40b0-a449-c33a25678351]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'akjTrJwG'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9139c0fe-55fa-4a8f-8d2d-cc6679d73d76]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6c53d-67e0-467e-b858-e7fba929e1cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:58 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[807091e4-f671-4126-b245-63b5e52ca019]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612, portal: 172.16.0.220,3260]
Oct 20 11:36:58 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612, portal: 172.16.0.220,3260] successful.
Oct 20 11:36:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[77206e2b-15f7-4273-9eaa-28ea1af2704c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ab6585-5db2-43cf-8ce9-e91075e289b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:59 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:36:59 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:36:59 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.369s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c770de-ef7f-428c-88d9-c2bac4cad8be]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:36:59 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Deleted allocations for instance 6a1b5fb2-449e-4648-8dc0-276813417b1d
Oct 20 11:36:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8b03ed4c-4030-49bb-a503-dd4430c355a5 tempest-DeleteServersTestJSON-263461688 tempest-DeleteServersTestJSON-263461688-project-member] Lock "6a1b5fb2-449e-4648-8dc0-276813417b1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 23.317s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] No BDM found with device name sda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] No VIF found with MAC fa:16:3e:6e:5b:82, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a4e40cd7-7ebb-4d95-b417-6e388543c307 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 77.940s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:36:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akjTrJwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] <== connect_volume: return (2537ms) {'type': 'block', 'scsi_wwn': '23263643334386637', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263643334386637', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.267s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG nova.objects.instance [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lazy-loading 'flavor' on Instance uuid d77d035b-ec54-4c5e-8dd6-55e5297b02fb {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1134784-77bc-4a8a-ae8d-4bc8068744b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:37:00 user nova-compute[74241]: No targets found.
Oct 20 11:37:00 user nova-compute[74241]: iSNS:
Oct 20 11:37:00 user nova-compute[74241]: No targets found.
Oct 20 11:37:00 user nova-compute[74241]: STATIC:
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414
Oct 20 11:37:00 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:00 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:00 user nova-compute[74241]: FIRMWARE:
Oct 20 11:37:00 user nova-compute[74241]: No targets found.
Oct 20 11:37:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:37:00 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:37:00 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f3c23e-54af-454d-b709-5c322afd0d17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:00 user nova-compute[74241]: INFO nova.compute.manager [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Detaching volume 2fea6248-ed62-4bb6-b46b-6a891c1ad414
Oct 20 11:37:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db240d1-6e2d-40ed-b924-56cab5395950]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:00 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52087c4b80>, {}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Disconnecting from: [] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.107s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] <== disconnect_volume: return (2374ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 124780544 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:37:01 user nova-compute[74241]: INFO nova.compute.claims [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Claim successful on node user
Oct 20 11:37:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Preparing to wait for external event volume-reimaged-2238763d-1ef0-47ab-8b4d-426b0d0d935b {{(pid=74241) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:01 user nova-compute[74241]: INFO nova.virt.block_device [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Attempting to driver detach volume 2fea6248-ed62-4bb6-b46b-6a891c1ad414 from mountpoint /dev/sdc
Oct 20 11:37:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Attempting to detach device sdc from instance d128bb7d-42b2-4d1a-94c0-de749ec2235c from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:37:01 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:37:01 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:37:01 user nova-compute[74241]:   <target dev="sdc" bus="scsi"/>
Oct 20 11:37:01 user nova-compute[74241]:   <serial>2fea6248-ed62-4bb6-b46b-6a891c1ad414</serial>
Oct 20 11:37:01 user nova-compute[74241]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 11:37:01 user nova-compute[74241]: </disk>
Oct 20 11:37:01 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:37:01 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Successfully detached device sdc from instance d128bb7d-42b2-4d1a-94c0-de749ec2235c from the persistent domain config.
Oct 20 11:37:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d128bb7d-42b2-4d1a-94c0-de749ec2235c from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:37:01 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:37:01 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:37:01 user nova-compute[74241]:   <target dev="sdc" bus="scsi"/>
Oct 20 11:37:01 user nova-compute[74241]:   <serial>2fea6248-ed62-4bb6-b46b-6a891c1ad414</serial>
Oct 20 11:37:01 user nova-compute[74241]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 11:37:01 user nova-compute[74241]: </disk>
Oct 20 11:37:01 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 257949696 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d128bb7d-42b2-4d1a-94c0-de749ec2235c {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 318767104 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.916s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.network.neutron [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:37:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.policy [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d7605635edc4cf9bddad897b8c18b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4449c61c4f64b2f96f4ac79b72c8f95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:37:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Creating image(s)
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 424673280 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk 1073741824" returned: 0 in 0.072s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Successfully created port: bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 472907776 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.275s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Cannot resize image /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Ensure instance console log exists: /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 607125504 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Successfully updated port: bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquired lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-a0de9969-079c-4230-b903-1d2c40fd59cb req-35ca03ba-9dcf-44b7-a851-a16fa137e947 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-changed-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-a0de9969-079c-4230-b903-1d2c40fd59cb req-35ca03ba-9dcf-44b7-a851-a16fa137e947 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Refreshing instance network info cache due to event network-changed-bca45587-745d-4a9a-82bd-17d504fa1d16. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a0de9969-079c-4230-b903-1d2c40fd59cb req-35ca03ba-9dcf-44b7-a851-a16fa137e947 service nova] Acquiring lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 750780416 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updating instance_info_cache with network_info: [{"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Releasing lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance network_info: |[{"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a0de9969-079c-4230-b903-1d2c40fd59cb req-35ca03ba-9dcf-44b7-a851-a16fa137e947 service nova] Acquired lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.network.neutron [req-a0de9969-079c-4230-b903-1d2c40fd59cb req-35ca03ba-9dcf-44b7-a851-a16fa137e947 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Refreshing network info cache for port bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Start _get_guest_xml network_info=[{"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:37:04 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:37:04 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-325758242',display_name='tempest-tempest.common.compute-instance-325758242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-325758242',id=12,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfdRRJbVskDjUThR/IvsP9b1m3vihpGe7aDy8UUiNypatNlCMWiRW9yckmulY6+ixramzXREUBSZQPfWajqoa/vgaSkHTU6CP3WpmBYFOXyTjhpz8m1yETa+pNT54qdoA==',key_name='tempest-keypair-1196191213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-a1kpnac2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=c19279cb-daa2-491e-8288-e0f2ce35dc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.objects.instance [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'pci_devices' on Instance uuid c19279cb-daa2-491e-8288-e0f2ce35dc1b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:37:04 user nova-compute[74241]:   <uuid>c19279cb-daa2-491e-8288-e0f2ce35dc1b</uuid>
Oct 20 11:37:04 user nova-compute[74241]:   <name>instance-0000000c</name>
Oct 20 11:37:04 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:37:04 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:37:04 user nova-compute[74241]:   <metadata>
Oct 20 11:37:04 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:04 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:37:04 user nova-compute[74241]:       <nova:name>tempest-tempest.common.compute-instance-325758242</nova:name>
Oct 20 11:37:04 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:37:04</nova:creationTime>
Oct 20 11:37:04 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:37:04 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:37:04 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:37:04 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:37:04 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:04 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:04 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:37:04 user nova-compute[74241]:       <nova:owner>
Oct 20 11:37:04 user nova-compute[74241]:         <nova:user uuid="3d7605635edc4cf9bddad897b8c18b77">tempest-ServerActionsTestOtherA-1364765065-project-member</nova:user>
Oct 20 11:37:04 user nova-compute[74241]:         <nova:project uuid="f4449c61c4f64b2f96f4ac79b72c8f95">tempest-ServerActionsTestOtherA-1364765065</nova:project>
Oct 20 11:37:04 user nova-compute[74241]:       </nova:owner>
Oct 20 11:37:04 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:04 user nova-compute[74241]:       <nova:ports>
Oct 20 11:37:04 user nova-compute[74241]:         <nova:port uuid="bca45587-745d-4a9a-82bd-17d504fa1d16">
Oct 20 11:37:04 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 11:37:04 user nova-compute[74241]:         </nova:port>
Oct 20 11:37:04 user nova-compute[74241]:       </nova:ports>
Oct 20 11:37:04 user nova-compute[74241]:     </nova:instance>
Oct 20 11:37:04 user nova-compute[74241]:   </metadata>
Oct 20 11:37:04 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:37:04 user nova-compute[74241]:     <system>
Oct 20 11:37:04 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:37:04 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:37:04 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:37:04 user nova-compute[74241]:       <entry name="serial">c19279cb-daa2-491e-8288-e0f2ce35dc1b</entry>
Oct 20 11:37:04 user nova-compute[74241]:       <entry name="uuid">c19279cb-daa2-491e-8288-e0f2ce35dc1b</entry>
Oct 20 11:37:04 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:37:04 user nova-compute[74241]:     </system>
Oct 20 11:37:04 user nova-compute[74241]:   </sysinfo>
Oct 20 11:37:04 user nova-compute[74241]:   <os>
Oct 20 11:37:04 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:37:04 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:37:04 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:37:04 user nova-compute[74241]:   </os>
Oct 20 11:37:04 user nova-compute[74241]:   <features>
Oct 20 11:37:04 user nova-compute[74241]:     <acpi/>
Oct 20 11:37:04 user nova-compute[74241]:     <apic/>
Oct 20 11:37:04 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:37:04 user nova-compute[74241]:   </features>
Oct 20 11:37:04 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:37:04 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:37:04 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:37:04 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:37:04 user nova-compute[74241]:   </clock>
Oct 20 11:37:04 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:37:04 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:37:04 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:37:04 user nova-compute[74241]:   </cpu>
Oct 20 11:37:04 user nova-compute[74241]:   <devices>
Oct 20 11:37:04 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:37:04 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:37:04 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk"/>
Oct 20 11:37:04 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:37:04 user nova-compute[74241]:     </disk>
Oct 20 11:37:04 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:37:04 user nova-compute[74241]:       <mac address="fa:16:3e:74:36:99"/>
Oct 20 11:37:04 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:37:04 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:37:04 user nova-compute[74241]:       <target dev="tapbca45587-74"/>
Oct 20 11:37:04 user nova-compute[74241]:     </interface>
Oct 20 11:37:04 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:37:04 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/console.log" append="off"/>
Oct 20 11:37:04 user nova-compute[74241]:     </serial>
Oct 20 11:37:04 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:37:04 user nova-compute[74241]:     <video>
Oct 20 11:37:04 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:37:04 user nova-compute[74241]:     </video>
Oct 20 11:37:04 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:37:04 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:37:04 user nova-compute[74241]:     </rng>
Oct 20 11:37:04 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:37:04 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:37:04 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:37:04 user nova-compute[74241]:     </memballoon>
Oct 20 11:37:04 user nova-compute[74241]:   </devices>
Oct 20 11:37:04 user nova-compute[74241]: </domain>
Oct 20 11:37:04 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-325758242',display_name='tempest-tempest.common.compute-instance-325758242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-325758242',id=12,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfdRRJbVskDjUThR/IvsP9b1m3vihpGe7aDy8UUiNypatNlCMWiRW9yckmulY6+ixramzXREUBSZQPfWajqoa/vgaSkHTU6CP3WpmBYFOXyTjhpz8m1yETa+pNT54qdoA==',key_name='tempest-keypair-1196191213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-a1kpnac2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=c19279cb-daa2-491e-8288-e0f2ce35dc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG os_vif [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d45f3da-2a73-5cfb-823a-14a154c2df7f', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbca45587-74, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbca45587-74, col_values=(('qos', UUID('5a1f3531-0fe6-4c1b-b438-d95fe481c94a')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbca45587-74, col_values=(('external_ids', {'iface-id': 'bca45587-745d-4a9a-82bd-17d504fa1d16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:36:99', 'vm-uuid': 'c19279cb-daa2-491e-8288-e0f2ce35dc1b'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:04 user nova-compute[74241]: INFO os_vif [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74')
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No VIF found with MAC fa:16:3e:74:36:99, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 915406848 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.network.neutron [req-a0de9969-079c-4230-b903-1d2c40fd59cb req-35ca03ba-9dcf-44b7-a851-a16fa137e947 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updated VIF entry in instance network info cache for port bca45587-745d-4a9a-82bd-17d504fa1d16. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG nova.network.neutron [req-a0de9969-079c-4230-b903-1d2c40fd59cb req-35ca03ba-9dcf-44b7-a851-a16fa137e947 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updating instance_info_cache with network_info: [{"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a0de9969-079c-4230-b903-1d2c40fd59cb req-35ca03ba-9dcf-44b7-a851-a16fa137e947 service nova] Releasing lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:37:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 1058013184 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:06 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f57f7-0cd3-460e-b339-685647b2e04a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:37:06 user nova-compute[74241]: No targets found.
Oct 20 11:37:06 user nova-compute[74241]: iSNS:
Oct 20 11:37:06 user nova-compute[74241]: No targets found.
Oct 20 11:37:06 user nova-compute[74241]: STATIC:
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414
Oct 20 11:37:06 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:06 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:06 user nova-compute[74241]: FIRMWARE:
Oct 20 11:37:06 user nova-compute[74241]: No targets found.
Oct 20 11:37:06 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:37:06 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:37:06 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7206b044-a9fd-4859-b7bd-2bbd404862b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[159258e2-bb1e-4dcf-89e2-1e031fe95b57]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:06 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:06 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:06 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f520879ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc'): ({'sdd'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Removing single pathed devices sdd {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e3a1cc-ffa9-4aee-982e-8a300251b5b5]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-91631ae5-065f-40fb-bff4-745943e12131 req-26fe2348-2c94-44a6-b6e6-78d5e8cfb874 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-91631ae5-065f-40fb-bff4-745943e12131 req-26fe2348-2c94-44a6-b6e6-78d5e8cfb874 service nova] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-91631ae5-065f-40fb-bff4-745943e12131 req-26fe2348-2c94-44a6-b6e6-78d5e8cfb874 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-91631ae5-065f-40fb-bff4-745943e12131 req-26fe2348-2c94-44a6-b6e6-78d5e8cfb874 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-91631ae5-065f-40fb-bff4-745943e12131 req-26fe2348-2c94-44a6-b6e6-78d5e8cfb874 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] No waiting events found dispatching network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:06 user nova-compute[74241]: WARNING nova.compute.manager [req-91631ae5-065f-40fb-bff4-745943e12131 req-26fe2348-2c94-44a6-b6e6-78d5e8cfb874 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received unexpected event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 for instance with vm_state building and task_state spawning.
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[27355be1-83e8-4ad7-a70e-c8a380db2ba1]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Flushing IO for device /dev/sdd {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb73765-be18-42d3-a79f-9755b9a649b9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0abb703-3b19-4c46-b89c-2154137c2a89]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943f4c0-02cc-44bc-99eb-e91dcfd5833d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[001ffb08-9ff5-4ee9-820c-edfea5d6f662]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260]
Oct 20 11:37:06 user nova-compute[74241]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260] successful.
Oct 20 11:37:06 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8a815-78b2-40ea-96c5-7073672f0b81]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] <== disconnect_volume: return (393ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akjTrJwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb', 'attached_at': '', 'detached_at': '', 'volume_id': '5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'serial'} {{(pid=74241) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] swap_volume: removing Cinder connection for volume c2ef804d-dc18-47c8-9809-8a29ea62bdbc {{(pid=74241) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 11:37:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:37:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance spawned successfully.
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-a3ee0320-99a7-4dcc-b23c-b553ac3abc85 req-8527fccd-e83a-44ef-81e0-6a8ba12ca5d4 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a3ee0320-99a7-4dcc-b23c-b553ac3abc85 req-8527fccd-e83a-44ef-81e0-6a8ba12ca5d4 service nova] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a3ee0320-99a7-4dcc-b23c-b553ac3abc85 req-8527fccd-e83a-44ef-81e0-6a8ba12ca5d4 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a3ee0320-99a7-4dcc-b23c-b553ac3abc85 req-8527fccd-e83a-44ef-81e0-6a8ba12ca5d4 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-a3ee0320-99a7-4dcc-b23c-b553ac3abc85 req-8527fccd-e83a-44ef-81e0-6a8ba12ca5d4 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] No waiting events found dispatching network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:08 user nova-compute[74241]: WARNING nova.compute.manager [req-a3ee0320-99a7-4dcc-b23c-b553ac3abc85 req-8527fccd-e83a-44ef-81e0-6a8ba12ca5d4 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received unexpected event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 for instance with vm_state building and task_state spawning.
Oct 20 11:37:08 user nova-compute[74241]: INFO nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Took 5.86 seconds to spawn the instance on the hypervisor.
Oct 20 11:37:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:37:08 user nova-compute[74241]: INFO nova.compute.manager [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Took 7.23 seconds to build instance.
Oct 20 11:37:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-957f1363-4f83-4c80-90fc-2fdf3a06431e tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.390s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:18 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9f326446-5aa8-47f0-bc97-0f2c9664319f is timed out.
Oct 20 11:37:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Successfully detached device vdb from instance 9f326446-5aa8-47f0-bc97-0f2c9664319f from the live domain config.
Oct 20 11:37:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GRmfwLky', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:18 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ee200-c966-4dba-a1f9-7bb2195bb1de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:37:18 user nova-compute[74241]: No targets found.
Oct 20 11:37:18 user nova-compute[74241]: iSNS:
Oct 20 11:37:18 user nova-compute[74241]: No targets found.
Oct 20 11:37:18 user nova-compute[74241]: STATIC:
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: FIRMWARE:
Oct 20 11:37:18 user nova-compute[74241]: No targets found.
Oct 20 11:37:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:37:18 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:37:18 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25bd471-9861-4194-99fa-e2c01afcaf7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c1f669-2e42-493d-9ea3-fe334c14a24b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5228375240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514'): ({'sde'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Removing single pathed devices sde {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a382c2-d528-4835-8b0d-ebc3eaa65b17]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87f95b8-4086-4bb8-98e3-df53e87c33d4]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Flushing IO for device /dev/sde {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5c6ec9-dc39-4e0e-a6ad-0dbc32c827a4]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e9611b-f74e-4ad9-a203-82a03111fb5d]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce5db41-08cc-4843-b3a7-e5c1c4749af7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c649fc0e-5f7d-41f6-bebb-d23d3b9b01e6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514, portal: 172.16.0.220,3260]
Oct 20 11:37:18 user nova-compute[74241]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514, portal: 172.16.0.220,3260] successful.
Oct 20 11:37:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 is timed out.
Oct 20 11:37:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Successfully detached device vdb from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 from the live domain config.
Oct 20 11:37:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'glizWuTH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:18 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe3b99c1-eb07-48d8-840e-9fd6b90cf514 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3e9000-8fc0-4364-9d90-3bfcc2e9a516]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] <== disconnect_volume: return (336ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.023s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[824022c1-1cae-42b2-bf93-dc1b10c04245]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:37:18 user nova-compute[74241]: No targets found.
Oct 20 11:37:18 user nova-compute[74241]: iSNS:
Oct 20 11:37:18 user nova-compute[74241]: No targets found.
Oct 20 11:37:18 user nova-compute[74241]: STATIC:
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414
Oct 20 11:37:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:18 user nova-compute[74241]: FIRMWARE:
Oct 20 11:37:18 user nova-compute[74241]: No targets found.
Oct 20 11:37:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:37:18 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:37:18 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae45016c-1a21-4f10-8064-c9083599d979]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[11214b07-0aec-45d4-bfcf-3cc50a27221f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:18 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52087d2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a'): ({'sdf'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Removing single pathed devices sdf {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b19b3-6840-4ef2-ab79-854dbfa94e5d]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08e3d28-6a58-473c-be8a-190a5e353d10]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Flushing IO for device /dev/sdf {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bc2a57-caf3-4bdc-bf18-04151d63a928]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b61340a-56af-4d1d-a58a-d58593bf6034]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] SCSI volumes sdf have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[77da516d-b7d6-4cb4-ab0d-4f24c16ffa4b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[db49935a-ae09-433e-9dc5-62f09b18554f]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a, portal: 172.16.0.220,3260]
Oct 20 11:37:19 user nova-compute[74241]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a, portal: 172.16.0.220,3260] successful.
Oct 20 11:37:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04e7867b-9132-40f0-8536-c0f807ccc13a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2575e56c-f06e-453a-b813-7aabc8608759]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] <== disconnect_volume: return (357ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:37:19 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d is timed out.
Oct 20 11:37:19 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Successfully detached device vdb from instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d from the live domain config.
Oct 20 11:37:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AnegUxwS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:19 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f08f1c-9aff-49b0-bfec-9cb3f2011329]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:37:19 user nova-compute[74241]: No targets found.
Oct 20 11:37:19 user nova-compute[74241]: iSNS:
Oct 20 11:37:19 user nova-compute[74241]: No targets found.
Oct 20 11:37:19 user nova-compute[74241]: STATIC:
Oct 20 11:37:19 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:37:19 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:19 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:19 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:37:19 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:19 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:19 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612
Oct 20 11:37:19 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:19 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:19 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae
Oct 20 11:37:19 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:19 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:19 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:37:19 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:19 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:19 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414
Oct 20 11:37:19 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:19 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:19 user nova-compute[74241]: FIRMWARE:
Oct 20 11:37:19 user nova-compute[74241]: No targets found.
Oct 20 11:37:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:37:19 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:37:19 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad954c60-770a-43be-924b-8fbd295c1aee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3cccbe-44b7-47f9-8cc1-c4bc09f3ecf6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:19 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5240390310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae'): ({'sdj'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Removing single pathed devices sdj {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[962f8225-d01a-4be5-9550-1d778f62988d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[592c6db8-6bc4-4a7a-81b8-39fea83e8f64]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Flushing IO for device /dev/sdj {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6cd91a-e360-49e9-9b5f-4391ef5da55c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.037s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7a07d9-fa22-4728-8092-7155efef3924]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] SCSI volumes sdj have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e779260a-261e-4271-bcea-f9d28ed9b799]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dada4a7-2f2e-47a5-97bd-6f2a46038af2]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae, portal: 172.16.0.220,3260]
Oct 20 11:37:19 user nova-compute[74241]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae, portal: 172.16.0.220,3260] successful.
Oct 20 11:37:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:127f3bca-0e69-48b2-9f07-1c60fb9f79ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f1d67b-199b-47f4-8155-a6b528de1877]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] <== disconnect_volume: return (328ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnCSkuNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:20 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[865cc7a3-1fef-4d17-bc3e-b765fae56623]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:37:20 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d68cc9e-8c4e-4ca6-8d0c-fd3f5b3db9c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6] added
Oct 20 11:37:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e5fc9d-f789-49c7-bd82-be974fe3878f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1460e3-283e-4d28-8c38-86cd7c0a4284]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnCSkuNm {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnCSkuNm" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[221f66df-2d7c-4bee-a8f5-3f69592e6c42]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BnCSkuNm'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d818a36-ab65-431f-a23c-d7b2450b81c8]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdb3a9d-b9d5-4aff-8ced-2be72a3add67]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb5f47d-0db4-4217-a408-46bbfe563f08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6, portal: 172.16.0.220,3260]
Oct 20 11:37:20 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6, portal: 172.16.0.220,3260] successful.
Oct 20 11:37:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0dcaba-673d-43c0-8aa5-0bbf1838ae38]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfab13ca-e77c-4bf4-a3ff-853f01487b7f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:20 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b7c8f-7ad1-4517-890c-29518a0cbbfd]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:37:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnCSkuNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:37:21 user nova-compute[74241]: DEBUG nova.objects.instance [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lazy-loading 'flavor' on Instance uuid 9f326446-5aa8-47f0-bc97-0f2c9664319f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-981755e5-8f16-4d1f-aa9c-8cfe3110f874 tempest-VolumesAssistedSnapshotsTest-1191109287 tempest-VolumesAssistedSnapshotsTest-1191109287-project-admin] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.231s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26164376666306430', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164376666306430', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:37:21 user nova-compute[74241]: DEBUG nova.objects.instance [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'flavor' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:37:21 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:37:21 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:37:21 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:37:21 user nova-compute[74241]:   <serial>55d0f928-afff-41a0-b970-021ed8f154b6</serial>
Oct 20 11:37:21 user nova-compute[74241]: </disk>
Oct 20 11:37:21 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:37:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance d128bb7d-42b2-4d1a-94c0-de749ec2235c is timed out.
Oct 20 11:37:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Successfully detached device sdc from instance d128bb7d-42b2-4d1a-94c0-de749ec2235c from the live domain config.
Oct 20 11:37:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MDFHQnVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:22 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7be283-8a5d-4bef-806e-1064561b3e2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:37:22 user nova-compute[74241]: No targets found.
Oct 20 11:37:22 user nova-compute[74241]: iSNS:
Oct 20 11:37:22 user nova-compute[74241]: No targets found.
Oct 20 11:37:22 user nova-compute[74241]: STATIC:
Oct 20 11:37:22 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:37:22 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:22 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:22 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:37:22 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:22 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:22 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612
Oct 20 11:37:22 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:22 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:22 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:37:22 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:22 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:22 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:37:22 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:22 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:22 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414
Oct 20 11:37:22 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:22 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:22 user nova-compute[74241]: FIRMWARE:
Oct 20 11:37:22 user nova-compute[74241]: No targets found.
Oct 20 11:37:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:37:22 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:37:22 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2948bf13-2815-46d6-b050-5b1e7bc16fee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bbc3bb-f0bf-47e0-8ad4-604b7be0131e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:22 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52087d1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No VIF found with MAC fa:16:3e:00:c5:3e, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e35ff1-ccfd-499d-9c68-d9f491bb3129]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[47011a44-efdf-407b-b9a5-60650e188332]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d88bca-0530-449d-baee-485c5238fbd1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d49475-7229-455a-805d-32aefad0a0ec]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lazy-loading 'flavor' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a56ff96-d7f1-41c4-ae8c-3713e69b4f3d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d5607dbd-2fa9-4577-bf07-39d119f19972 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.716s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7ab20f-90c4-4ef7-af2a-6f035cfc03b3]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414, portal: 172.16.0.220,3260]
Oct 20 11:37:22 user nova-compute[74241]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414, portal: 172.16.0.220,3260] successful.
Oct 20 11:37:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fea6248-ed62-4bb6-b46b-6a891c1ad414 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[537a197e-5029-423c-a529-f4351944a9d9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] <== disconnect_volume: return (398ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lazy-loading 'flavor' on Instance uuid 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a6de14c1-bcd1-40b1-b586-204059f59565 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.836s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "interface-726a7f29-03b0-489f-a77d-9a77e5c4a546-2348d99b-d4b3-4938-ab06-ab5aa38e5116" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "interface-726a7f29-03b0-489f-a77d-9a77e5c4a546-2348d99b-d4b3-4938-ab06-ab5aa38e5116" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.objects.instance [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lazy-loading 'flavor' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converting VIF {"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface> {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface> {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Attempting to detach device tap2348d99b-d4 from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] detach device xml: <interface type="ethernet">
Oct 20 11:37:23 user nova-compute[74241]:   <mac address="fa:16:3e:fc:c5:d6"/>
Oct 20 11:37:23 user nova-compute[74241]:   <model type="virtio"/>
Oct 20 11:37:23 user nova-compute[74241]:   <mtu size="1442"/>
Oct 20 11:37:23 user nova-compute[74241]:   <target dev="tap2348d99b-d4"/>
Oct 20 11:37:23 user nova-compute[74241]: </interface>
Oct 20 11:37:23 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.volume.cinder [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Update attachment failed for attachment 7988a50a-ce62-4e3c-9fb5-60b94ccf15e4. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2583ed40-e6c2-4ee0-8ae2-bc33a4f497ec) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2583ed40-e6c2-4ee0-8ae2-bc33a4f497ec)
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface> {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 11:37:23 user nova-compute[74241]:   <name>instance-00000007</name>
Oct 20 11:37:23 user nova-compute[74241]:   <uuid>726a7f29-03b0-489f-a77d-9a77e5c4a546</uuid>
Oct 20 11:37:23 user nova-compute[74241]:   <metadata>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:23 user nova-compute[74241]:   <nova:package version="0.0.0"/>
Oct 20 11:37:23 user nova-compute[74241]:   <nova:name>tempest-device-tagging-server-1761481514</nova:name>
Oct 20 11:37:23 user nova-compute[74241]:   <nova:creationTime>2023-10-20 11:35:26</nova:creationTime>
Oct 20 11:37:23 user nova-compute[74241]:   <nova:flavor name="m1.tiny">
Oct 20 11:37:23 user nova-compute[74241]:     <nova:memory>512</nova:memory>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:disk>1</nova:disk>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:swap>0</nova:swap>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:23 user nova-compute[74241]:   </nova:flavor>
Oct 20 11:37:23 user nova-compute[74241]:   <nova:owner>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:user uuid="16555d6cef90422db4c851511083a34f">tempest-TaggedAttachmentsTest-20080626-project-member</nova:user>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:project uuid="ccb28511a3ff4f30bffdd7c8aa870c39">tempest-TaggedAttachmentsTest-20080626</nova:project>
Oct 20 11:37:23 user nova-compute[74241]:   </nova:owner>
Oct 20 11:37:23 user nova-compute[74241]:   <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:23 user nova-compute[74241]:   <nova:ports>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:port uuid="88fde83f-c742-460e-8d1a-78982cbb685e">
Oct 20 11:37:23 user nova-compute[74241]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:37:23 user nova-compute[74241]:     </nova:port>
Oct 20 11:37:23 user nova-compute[74241]:     <nova:port uuid="2348d99b-d4b3-4938-ab06-ab5aa38e5116">
Oct 20 11:37:23 user nova-compute[74241]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Oct 20 11:37:23 user nova-compute[74241]:     </nova:port>
Oct 20 11:37:23 user nova-compute[74241]:   </nova:ports>
Oct 20 11:37:23 user nova-compute[74241]: </nova:instance>
Oct 20 11:37:23 user nova-compute[74241]:   </metadata>
Oct 20 11:37:23 user nova-compute[74241]:   <memory unit='KiB'>524288</memory>
Oct 20 11:37:23 user nova-compute[74241]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 11:37:23 user nova-compute[74241]:   <vcpu placement='static'>1</vcpu>
Oct 20 11:37:23 user nova-compute[74241]:   <resource>
Oct 20 11:37:23 user nova-compute[74241]:     <partition>/machine</partition>
Oct 20 11:37:23 user nova-compute[74241]:   </resource>
Oct 20 11:37:23 user nova-compute[74241]:   <sysinfo type='smbios'>
Oct 20 11:37:23 user nova-compute[74241]:     <system>
Oct 20 11:37:23 user nova-compute[74241]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 11:37:23 user nova-compute[74241]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 11:37:23 user nova-compute[74241]:       <entry name='version'>0.0.0</entry>
Oct 20 11:37:23 user nova-compute[74241]:       <entry name='serial'>726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:37:23 user nova-compute[74241]:       <entry name='uuid'>726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:37:23 user nova-compute[74241]:       <entry name='family'>Virtual Machine</entry>
Oct 20 11:37:23 user nova-compute[74241]:     </system>
Oct 20 11:37:23 user nova-compute[74241]:   </sysinfo>
Oct 20 11:37:23 user nova-compute[74241]:   <os>
Oct 20 11:37:23 user nova-compute[74241]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 11:37:23 user nova-compute[74241]:     <boot dev='hd'/>
Oct 20 11:37:23 user nova-compute[74241]:     <smbios mode='sysinfo'/>
Oct 20 11:37:23 user nova-compute[74241]:   </os>
Oct 20 11:37:23 user nova-compute[74241]:   <features>
Oct 20 11:37:23 user nova-compute[74241]:     <acpi/>
Oct 20 11:37:23 user nova-compute[74241]:     <apic/>
Oct 20 11:37:23 user nova-compute[74241]:     <vmcoreinfo state='on'/>
Oct 20 11:37:23 user nova-compute[74241]:   </features>
Oct 20 11:37:23 user nova-compute[74241]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 11:37:23 user nova-compute[74241]:     <model fallback='forbid'>Nehalem</model>
Oct 20 11:37:23 user nova-compute[74241]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 11:37:23 user nova-compute[74241]:     <feature policy='require' name='vme'/>
Oct 20 11:37:23 user nova-compute[74241]:     <feature policy='require' name='x2apic'/>
Oct 20 11:37:23 user nova-compute[74241]:     <feature policy='require' name='hypervisor'/>
Oct 20 11:37:23 user nova-compute[74241]:   </cpu>
Oct 20 11:37:23 user nova-compute[74241]:   <clock offset='utc'>
Oct 20 11:37:23 user nova-compute[74241]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 11:37:23 user nova-compute[74241]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 11:37:23 user nova-compute[74241]:     <timer name='hpet' present='no'/>
Oct 20 11:37:23 user nova-compute[74241]:   </clock>
Oct 20 11:37:23 user nova-compute[74241]:   <on_poweroff>destroy</on_poweroff>
Oct 20 11:37:23 user nova-compute[74241]:   <on_reboot>restart</on_reboot>
Oct 20 11:37:23 user nova-compute[74241]:   <on_crash>destroy</on_crash>
Oct 20 11:37:23 user nova-compute[74241]:   <devices>
Oct 20 11:37:23 user nova-compute[74241]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 11:37:23 user nova-compute[74241]:     <disk type='file' device='disk'>
Oct 20 11:37:23 user nova-compute[74241]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 11:37:23 user nova-compute[74241]:       <source file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk' index='2'/>
Oct 20 11:37:23 user nova-compute[74241]:       <backingStore type='file' index='3'>
Oct 20 11:37:23 user nova-compute[74241]:         <format type='raw'/>
Oct 20 11:37:23 user nova-compute[74241]:         <source file='/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555'/>
Oct 20 11:37:23 user nova-compute[74241]:         <backingStore/>
Oct 20 11:37:23 user nova-compute[74241]:       </backingStore>
Oct 20 11:37:23 user nova-compute[74241]:       <target dev='vda' bus='virtio'/>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='virtio-disk0'/>
Oct 20 11:37:23 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </disk>
Oct 20 11:37:23 user nova-compute[74241]:     <disk type='file' device='cdrom'>
Oct 20 11:37:23 user nova-compute[74241]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 11:37:23 user nova-compute[74241]:       <source file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.config' index='1'/>
Oct 20 11:37:23 user nova-compute[74241]:       <backingStore/>
Oct 20 11:37:23 user nova-compute[74241]:       <target dev='hda' bus='ide'/>
Oct 20 11:37:23 user nova-compute[74241]:       <readonly/>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='ide0-0-0'/>
Oct 20 11:37:23 user nova-compute[74241]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </disk>
Oct 20 11:37:23 user nova-compute[74241]:     <controller type='usb' index='0' model='none'>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='usb'/>
Oct 20 11:37:23 user nova-compute[74241]:     </controller>
Oct 20 11:37:23 user nova-compute[74241]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='pci.0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </controller>
Oct 20 11:37:23 user nova-compute[74241]:     <controller type='ide' index='0'>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='ide'/>
Oct 20 11:37:23 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 11:37:23 user nova-compute[74241]:     </controller>
Oct 20 11:37:23 user nova-compute[74241]:     <interface type='ethernet'>
Oct 20 11:37:23 user nova-compute[74241]:       <mac address='fa:16:3e:ae:a1:83'/>
Oct 20 11:37:23 user nova-compute[74241]:       <target dev='tap88fde83f-c7'/>
Oct 20 11:37:23 user nova-compute[74241]:       <model type='virtio'/>
Oct 20 11:37:23 user nova-compute[74241]:       <mtu size='1442'/>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='net0'/>
Oct 20 11:37:23 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </interface>
Oct 20 11:37:23 user nova-compute[74241]:     <interface type='ethernet'>
Oct 20 11:37:23 user nova-compute[74241]:       <mac address='fa:16:3e:fc:c5:d6'/>
Oct 20 11:37:23 user nova-compute[74241]:       <target dev='tap2348d99b-d4'/>
Oct 20 11:37:23 user nova-compute[74241]:       <model type='virtio'/>
Oct 20 11:37:23 user nova-compute[74241]:       <mtu size='1442'/>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='net1'/>
Oct 20 11:37:23 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </interface>
Oct 20 11:37:23 user nova-compute[74241]:     <serial type='pty'>
Oct 20 11:37:23 user nova-compute[74241]:       <source path='/dev/pts/6'/>
Oct 20 11:37:23 user nova-compute[74241]:       <log file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log' append='off'/>
Oct 20 11:37:23 user nova-compute[74241]:       <target type='isa-serial' port='0'>
Oct 20 11:37:23 user nova-compute[74241]:         <model name='isa-serial'/>
Oct 20 11:37:23 user nova-compute[74241]:       </target>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='serial0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </serial>
Oct 20 11:37:23 user nova-compute[74241]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 11:37:23 user nova-compute[74241]:       <source path='/dev/pts/6'/>
Oct 20 11:37:23 user nova-compute[74241]:       <log file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log' append='off'/>
Oct 20 11:37:23 user nova-compute[74241]:       <target type='serial' port='0'/>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='serial0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </console>
Oct 20 11:37:23 user nova-compute[74241]:     <input type='mouse' bus='ps2'>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='input0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </input>
Oct 20 11:37:23 user nova-compute[74241]:     <input type='keyboard' bus='ps2'>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='input1'/>
Oct 20 11:37:23 user nova-compute[74241]:     </input>
Oct 20 11:37:23 user nova-compute[74241]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 11:37:23 user nova-compute[74241]:       <listen type='address' address='0.0.0.0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </graphics>
Oct 20 11:37:23 user nova-compute[74241]:     <audio id='1' type='none'/>
Oct 20 11:37:23 user nova-compute[74241]:     <video>
Oct 20 11:37:23 user nova-compute[74241]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='video0'/>
Oct 20 11:37:23 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </video>
Oct 20 11:37:23 user nova-compute[74241]:     <memballoon model='virtio'>
Oct 20 11:37:23 user nova-compute[74241]:       <stats period='10'/>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='balloon0'/>
Oct 20 11:37:23 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </memballoon>
Oct 20 11:37:23 user nova-compute[74241]:     <rng model='virtio'>
Oct 20 11:37:23 user nova-compute[74241]:       <backend model='random'>/dev/urandom</backend>
Oct 20 11:37:23 user nova-compute[74241]:       <alias name='rng0'/>
Oct 20 11:37:23 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 11:37:23 user nova-compute[74241]:     </rng>
Oct 20 11:37:23 user nova-compute[74241]:   </devices>
Oct 20 11:37:23 user nova-compute[74241]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 11:37:23 user nova-compute[74241]:     <label>libvirt-726a7f29-03b0-489f-a77d-9a77e5c4a546</label>
Oct 20 11:37:23 user nova-compute[74241]:     <imagelabel>libvirt-726a7f29-03b0-489f-a77d-9a77e5c4a546</imagelabel>
Oct 20 11:37:23 user nova-compute[74241]:   </seclabel>
Oct 20 11:37:23 user nova-compute[74241]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 11:37:23 user nova-compute[74241]:     <label>+64055:+108</label>
Oct 20 11:37:23 user nova-compute[74241]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 11:37:23 user nova-compute[74241]:   </seclabel>
Oct 20 11:37:23 user nova-compute[74241]: </domain>
Oct 20 11:37:23 user nova-compute[74241]:  {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 11:37:23 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Successfully detached device tap2348d99b-d4 from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 from the persistent domain config.
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] (1/8): Attempting to detach device tap2348d99b-d4 with device alias net1 from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] detach device xml: <interface type="ethernet">
Oct 20 11:37:23 user nova-compute[74241]:   <mac address="fa:16:3e:fc:c5:d6"/>
Oct 20 11:37:23 user nova-compute[74241]:   <model type="virtio"/>
Oct 20 11:37:23 user nova-compute[74241]:   <mtu size="1442"/>
Oct 20 11:37:23 user nova-compute[74241]:   <target dev="tap2348d99b-d4"/>
Oct 20 11:37:23 user nova-compute[74241]: </interface>
Oct 20 11:37:23 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2583ed40-e6c2-4ee0-8ae2-bc33a4f497ec)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Traceback (most recent call last):
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     driver_block_device.attach_block_devices(
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     _log_and_attach(device)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     bdm.attach(*attach_args, **attach_kwargs)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     self._do_attach(context, instance, volume, volume_api,
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     self._volume_attach(context, volume, connector, instance,
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     connection_info = volume_api.attachment_update(
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     res = method(self, ctx, *args, **kwargs)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     with excutils.save_and_reraise_exception():
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     self.force_reraise()
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     raise self.value
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     return method.func(obj, *args, **kwargs)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     resp = self._update('/attachments/%s' % id, body)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     return self.request(url, method, **kwargs)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1]     raise exceptions.from_response(resp, body)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2583ed40-e6c2-4ee0-8ae2-bc33a4f497ec)
Oct 20 11:37:23 user nova-compute[74241]: ERROR nova.compute.manager [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] 
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.compute.claims [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Aborting claim: <nova.compute.claims.Claim object at 0x7f522852f6d0> {{(pid=74241) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-259f9a53-8bda-4e4c-b1bf-4a653977ab3d tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.472s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.compute.manager [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] swap_volume: Updating volume c2ef804d-dc18-47c8-9809-8a29ea62bdbc BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "akjTrJwG", "auth_password": "gRbmCcjB2KzNS5", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "5c6c6907-ef85-41f4-a42e-7e7792f2c612"}, "status": "reserved", "instance": "d77d035b-ec54-4c5e-8dd6-55e5297b02fb", "attached_at": "", "detached_at": "", "volume_id": "5c6c6907-ef85-41f4-a42e-7e7792f2c612", "serial": "5c6c6907-ef85-41f4-a42e-7e7792f2c612"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'no_device': None, 'attachment_id': 'de8aedc2-2768-4af7-956b-58c24370512c'} {{(pid=74241) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-daed2040-4115-4c01-8aac-6e3f63ff4c82 tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 47.218s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Start waiting for the detach event from libvirt for device tap2348d99b-d4 with device alias net1 for instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.501s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Build of instance 3c73caa8-a299-41e1-bd85-66299f6641f1 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2583ed40-e6c2-4ee0-8ae2-bc33a4f497ec) {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.compute.utils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Build of instance 3c73caa8-a299-41e1-bd85-66299f6641f1 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74241) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 20 11:37:24 user nova-compute[74241]: ERROR nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Build of instance 3c73caa8-a299-41e1-bd85-66299f6641f1 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2583ed40-e6c2-4ee0-8ae2-bc33a4f497ec): nova.exception.BuildAbortException: Build of instance 3c73caa8-a299-41e1-bd85-66299f6641f1 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2583ed40-e6c2-4ee0-8ae2-bc33a4f497ec)
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Unplugging VIFs for instance {{(pid=74241) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508968224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1508968224',id=11,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsjSaqFpj6L5KeewxVeAgdUekUVpMUZSGx1RK8plHxC3KVkjR1euUBxH1/nMRGhMru01tNILrxV+OqJGEERLUf30C22vPngAdhJytBDDKLrGK1E8J8UXJRZ6Pdn2V9oTw==',key_name='tempest-keypair-243596162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77ffbdeb90da4caba0f0e4c73e5efe6d',ramdisk_id='',reservation_id='r-x07lha1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1193398918',owner_user_name='tempest-TaggedBootDevicesTest-1193398918-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207aeccc45bd4134bd5e8f30d69e5cb3',uuid=3c73caa8-a299-41e1-bd85-66299f6641f1,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "address": "fa:16:3e:96:1e:b4", "network": {"id": "513bbe18-a8ff-4022-b760-244a3f8db2f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-522003391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2dab0b-72", "ovs_interfaceid": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converting VIF {"id": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "address": "fa:16:3e:96:1e:b4", "network": {"id": "513bbe18-a8ff-4022-b760-244a3f8db2f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-522003391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f2dab0b-72", "ovs_interfaceid": "8f2dab0b-7264-471a-83bb-75d6dcdae095", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:1e:b4,bridge_name='br-int',has_traffic_filtering=True,id=8f2dab0b-7264-471a-83bb-75d6dcdae095,network=Network(513bbe18-a8ff-4022-b760-244a3f8db2f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2dab0b-72') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:1e:b4,bridge_name='br-int',has_traffic_filtering=True,id=8f2dab0b-7264-471a-83bb-75d6dcdae095,network=Network(513bbe18-a8ff-4022-b760-244a3f8db2f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2dab0b-72') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f2dab0b-72, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:24 user nova-compute[74241]: INFO os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:1e:b4,bridge_name='br-int',has_traffic_filtering=True,id=8f2dab0b-7264-471a-83bb-75d6dcdae095,network=Network(513bbe18-a8ff-4022-b760-244a3f8db2f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f2dab0b-72')
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508968224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1508968224',id=11,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsjSaqFpj6L5KeewxVeAgdUekUVpMUZSGx1RK8plHxC3KVkjR1euUBxH1/nMRGhMru01tNILrxV+OqJGEERLUf30C22vPngAdhJytBDDKLrGK1E8J8UXJRZ6Pdn2V9oTw==',key_name='tempest-keypair-243596162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77ffbdeb90da4caba0f0e4c73e5efe6d',ramdisk_id='',reservation_id='r-x07lha1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1193398918',owner_user_name='tempest-TaggedBootDevicesTest-1193398918-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207aeccc45bd4134bd5e8f30d69e5cb3',uuid=3c73caa8-a299-41e1-bd85-66299f6641f1,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac475a91-3125-4cab-9930-27b5757b31aa", "address": "fa:16:3e:ec:d8:2e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac475a91-31", "ovs_interfaceid": "ac475a91-3125-4cab-9930-27b5757b31aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converting VIF {"id": "ac475a91-3125-4cab-9930-27b5757b31aa", "address": "fa:16:3e:ec:d8:2e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.159", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac475a91-31", "ovs_interfaceid": "ac475a91-3125-4cab-9930-27b5757b31aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d8:2e,bridge_name='br-int',has_traffic_filtering=True,id=ac475a91-3125-4cab-9930-27b5757b31aa,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac475a91-31') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d8:2e,bridge_name='br-int',has_traffic_filtering=True,id=ac475a91-3125-4cab-9930-27b5757b31aa,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac475a91-31') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac475a91-31, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:24 user nova-compute[74241]: INFO os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d8:2e,bridge_name='br-int',has_traffic_filtering=True,id=ac475a91-3125-4cab-9930-27b5757b31aa,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapac475a91-31')
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508968224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1508968224',id=11,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsjSaqFpj6L5KeewxVeAgdUekUVpMUZSGx1RK8plHxC3KVkjR1euUBxH1/nMRGhMru01tNILrxV+OqJGEERLUf30C22vPngAdhJytBDDKLrGK1E8J8UXJRZ6Pdn2V9oTw==',key_name='tempest-keypair-243596162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77ffbdeb90da4caba0f0e4c73e5efe6d',ramdisk_id='',reservation_id='r-x07lha1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1193398918',owner_user_name='tempest-TaggedBootDevicesTest-1193398918-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207aeccc45bd4134bd5e8f30d69e5cb3',uuid=3c73caa8-a299-41e1-bd85-66299f6641f1,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afbf0e19-2c57-4036-8b9e-b775900c827d", "address": "fa:16:3e:64:c4:3e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbf0e19-2c", "ovs_interfaceid": "afbf0e19-2c57-4036-8b9e-b775900c827d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converting VIF {"id": "afbf0e19-2c57-4036-8b9e-b775900c827d", "address": "fa:16:3e:64:c4:3e", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.44", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafbf0e19-2c", "ovs_interfaceid": "afbf0e19-2c57-4036-8b9e-b775900c827d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:c4:3e,bridge_name='br-int',has_traffic_filtering=True,id=afbf0e19-2c57-4036-8b9e-b775900c827d,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapafbf0e19-2c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c4:3e,bridge_name='br-int',has_traffic_filtering=True,id=afbf0e19-2c57-4036-8b9e-b775900c827d,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapafbf0e19-2c') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafbf0e19-2c, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-93652333-e207-456b-a516-844603d66e4a req-ca8a9c12-916e-4ce0-806b-f4c474f63b51 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-unplugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93652333-e207-456b-a516-844603d66e4a req-ca8a9c12-916e-4ce0-806b-f4c474f63b51 service nova] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93652333-e207-456b-a516-844603d66e4a req-ca8a9c12-916e-4ce0-806b-f4c474f63b51 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93652333-e207-456b-a516-844603d66e4a req-ca8a9c12-916e-4ce0-806b-f4c474f63b51 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-93652333-e207-456b-a516-844603d66e4a req-ca8a9c12-916e-4ce0-806b-f4c474f63b51 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] No waiting events found dispatching network-vif-unplugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:24 user nova-compute[74241]: WARNING nova.compute.manager [req-93652333-e207-456b-a516-844603d66e4a req-ca8a9c12-916e-4ce0-806b-f4c474f63b51 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received unexpected event network-vif-unplugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 for instance with vm_state active and task_state None.
Oct 20 11:37:24 user nova-compute[74241]: INFO os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:c4:3e,bridge_name='br-int',has_traffic_filtering=True,id=afbf0e19-2c57-4036-8b9e-b775900c827d,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapafbf0e19-2c')
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508968224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1508968224',id=11,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsjSaqFpj6L5KeewxVeAgdUekUVpMUZSGx1RK8plHxC3KVkjR1euUBxH1/nMRGhMru01tNILrxV+OqJGEERLUf30C22vPngAdhJytBDDKLrGK1E8J8UXJRZ6Pdn2V9oTw==',key_name='tempest-keypair-243596162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77ffbdeb90da4caba0f0e4c73e5efe6d',ramdisk_id='',reservation_id='r-x07lha1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1193398918',owner_user_name='tempest-TaggedBootDevicesTest-1193398918-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207aeccc45bd4134bd5e8f30d69e5cb3',uuid=3c73caa8-a299-41e1-bd85-66299f6641f1,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "address": "fa:16:3e:67:63:17", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2484c0ad-ec", "ovs_interfaceid": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converting VIF {"id": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "address": "fa:16:3e:67:63:17", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2484c0ad-ec", "ovs_interfaceid": "2484c0ad-eccd-4f77-80b7-14b5057c00ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:63:17,bridge_name='br-int',has_traffic_filtering=True,id=2484c0ad-eccd-4f77-80b7-14b5057c00ed,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2484c0ad-ec') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:63:17,bridge_name='br-int',has_traffic_filtering=True,id=2484c0ad-eccd-4f77-80b7-14b5057c00ed,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2484c0ad-ec') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2484c0ad-ec, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:24 user nova-compute[74241]: INFO os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:63:17,bridge_name='br-int',has_traffic_filtering=True,id=2484c0ad-eccd-4f77-80b7-14b5057c00ed,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2484c0ad-ec')
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508968224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1508968224',id=11,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsjSaqFpj6L5KeewxVeAgdUekUVpMUZSGx1RK8plHxC3KVkjR1euUBxH1/nMRGhMru01tNILrxV+OqJGEERLUf30C22vPngAdhJytBDDKLrGK1E8J8UXJRZ6Pdn2V9oTw==',key_name='tempest-keypair-243596162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77ffbdeb90da4caba0f0e4c73e5efe6d',ramdisk_id='',reservation_id='r-x07lha1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1193398918',owner_user_name='tempest-TaggedBootDevicesTest-1193398918-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207aeccc45bd4134bd5e8f30d69e5cb3',uuid=3c73caa8-a299-41e1-bd85-66299f6641f1,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "address": "fa:16:3e:5f:49:1c", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781e6c5c-a3", "ovs_interfaceid": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converting VIF {"id": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "address": "fa:16:3e:5f:49:1c", "network": {"id": "4d1dcdee-24ee-4048-9100-cca69f68a8ac", "bridge": "br-int", "label": "tempest-device-tagging-net1-391594867", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.95", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap781e6c5c-a3", "ovs_interfaceid": "781e6c5c-a3ca-48f7-9bb4-0beccdc930a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:49:1c,bridge_name='br-int',has_traffic_filtering=True,id=781e6c5c-a3ca-48f7-9bb4-0beccdc930a6,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781e6c5c-a3') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:49:1c,bridge_name='br-int',has_traffic_filtering=True,id=781e6c5c-a3ca-48f7-9bb4-0beccdc930a6,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781e6c5c-a3') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap781e6c5c-a3, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:24 user nova-compute[74241]: INFO os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:49:1c,bridge_name='br-int',has_traffic_filtering=True,id=781e6c5c-a3ca-48f7-9bb4-0beccdc930a6,network=Network(4d1dcdee-24ee-4048-9100-cca69f68a8ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap781e6c5c-a3')
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508968224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1508968224',id=11,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsjSaqFpj6L5KeewxVeAgdUekUVpMUZSGx1RK8plHxC3KVkjR1euUBxH1/nMRGhMru01tNILrxV+OqJGEERLUf30C22vPngAdhJytBDDKLrGK1E8J8UXJRZ6Pdn2V9oTw==',key_name='tempest-keypair-243596162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77ffbdeb90da4caba0f0e4c73e5efe6d',ramdisk_id='',reservation_id='r-x07lha1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1193398918',owner_user_name='tempest-TaggedBootDevicesTest-1193398918-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207aeccc45bd4134bd5e8f30d69e5cb3',uuid=3c73caa8-a299-41e1-bd85-66299f6641f1,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "address": "fa:16:3e:a7:7c:f7", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e8e528-8a", "ovs_interfaceid": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converting VIF {"id": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "address": "fa:16:3e:a7:7c:f7", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89e8e528-8a", "ovs_interfaceid": "89e8e528-8a4f-4d1d-ba34-27a0d1511ce0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7c:f7,bridge_name='br-int',has_traffic_filtering=True,id=89e8e528-8a4f-4d1d-ba34-27a0d1511ce0,network=Network(78e9ca0b-131c-45fa-aa2f-6679c05c8be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e8e528-8a') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7c:f7,bridge_name='br-int',has_traffic_filtering=True,id=89e8e528-8a4f-4d1d-ba34-27a0d1511ce0,network=Network(78e9ca0b-131c-45fa-aa2f-6679c05c8be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e8e528-8a') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89e8e528-8a, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:24 user nova-compute[74241]: INFO os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7c:f7,bridge_name='br-int',has_traffic_filtering=True,id=89e8e528-8a4f-4d1d-ba34-27a0d1511ce0,network=Network(78e9ca0b-131c-45fa-aa2f-6679c05c8be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89e8e528-8a')
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1508968224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1508968224',id=11,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsjSaqFpj6L5KeewxVeAgdUekUVpMUZSGx1RK8plHxC3KVkjR1euUBxH1/nMRGhMru01tNILrxV+OqJGEERLUf30C22vPngAdhJytBDDKLrGK1E8J8UXJRZ6Pdn2V9oTw==',key_name='tempest-keypair-243596162',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77ffbdeb90da4caba0f0e4c73e5efe6d',ramdisk_id='',reservation_id='r-x07lha1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1193398918',owner_user_name='tempest-TaggedBootDevicesTest-1193398918-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207aeccc45bd4134bd5e8f30d69e5cb3',uuid=3c73caa8-a299-41e1-bd85-66299f6641f1,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "address": "fa:16:3e:e5:e0:4f", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9e5df6-b2", "ovs_interfaceid": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converting VIF {"id": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "address": "fa:16:3e:e5:e0:4f", "network": {"id": "78e9ca0b-131c-45fa-aa2f-6679c05c8be9", "bridge": "br-int", "label": "tempest-device-tagging-net2-909284608", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77ffbdeb90da4caba0f0e4c73e5efe6d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a9e5df6-b2", "ovs_interfaceid": "2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e0:4f,bridge_name='br-int',has_traffic_filtering=True,id=2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa,network=Network(78e9ca0b-131c-45fa-aa2f-6679c05c8be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9e5df6-b2') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e0:4f,bridge_name='br-int',has_traffic_filtering=True,id=2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa,network=Network(78e9ca0b-131c-45fa-aa2f-6679c05c8be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9e5df6-b2') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a9e5df6-b2, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:24 user nova-compute[74241]: INFO os_vif [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:e0:4f,bridge_name='br-int',has_traffic_filtering=True,id=2a9e5df6-b2c4-4d8f-b9c6-63d1d7e47baa,network=Network(78e9ca0b-131c-45fa-aa2f-6679c05c8be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a9e5df6-b2')
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Unplugged VIFs for instance {{(pid=74241) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lazy-loading 'flavor' on Instance uuid d128bb7d-42b2-4d1a-94c0-de749ec2235c {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-233f7db8-1187-4121-ab6b-64727de6b7c5 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.601s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:24 user nova-compute[74241]: INFO nova.compute.manager [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Rescuing
Oct 20 11:37:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:37:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG os_brick.utils [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf09ae2-2540-4810-8b71-7ce2e72a749a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[00eab523-a600-4e5d-9c69-bc9811e3593f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f98649-40b8-4d38-ad16-812ca4a2ca42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a923850-87d8-419d-85de-1eeb54d5ff79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:37:25 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1a4a84-0703-4dfe-a91c-d716052fdece]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG os_brick.utils [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:25 user nova-compute[74241]: INFO nova.compute.manager [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Swapping volume 5c6c6907-ef85-41f4-a42e-7e7792f2c612 for c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:37:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-db956d00-5625-4fdd-8f91-f4eb828a83e6 req-c82db071-792c-469f-ad07-dcee326fb6d0 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db956d00-5625-4fdd-8f91-f4eb828a83e6 req-c82db071-792c-469f-ad07-dcee326fb6d0 service nova] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db956d00-5625-4fdd-8f91-f4eb828a83e6 req-c82db071-792c-469f-ad07-dcee326fb6d0 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db956d00-5625-4fdd-8f91-f4eb828a83e6 req-c82db071-792c-469f-ad07-dcee326fb6d0 service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-db956d00-5625-4fdd-8f91-f4eb828a83e6 req-c82db071-792c-469f-ad07-dcee326fb6d0 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] No waiting events found dispatching network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:26 user nova-compute[74241]: WARNING nova.compute.manager [req-db956d00-5625-4fdd-8f91-f4eb828a83e6 req-c82db071-792c-469f-ad07-dcee326fb6d0 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received unexpected event network-vif-plugged-2348d99b-d4b3-4938-ab06-ab5aa38e5116 for instance with vm_state active and task_state None.
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:26 user nova-compute[74241]: INFO nova.compute.manager [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Terminating instance
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-b01bdeb1-fa22-4c0e-b5f2-5eff54890da5 req-fbf71483-22da-49f1-97e2-a4f4d1be5ae5 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b01bdeb1-fa22-4c0e-b5f2-5eff54890da5 req-fbf71483-22da-49f1-97e2-a4f4d1be5ae5 service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b01bdeb1-fa22-4c0e-b5f2-5eff54890da5 req-fbf71483-22da-49f1-97e2-a4f4d1be5ae5 service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b01bdeb1-fa22-4c0e-b5f2-5eff54890da5 req-fbf71483-22da-49f1-97e2-a4f4d1be5ae5 service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-b01bdeb1-fa22-4c0e-b5f2-5eff54890da5 req-fbf71483-22da-49f1-97e2-a4f4d1be5ae5 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:26 user nova-compute[74241]: WARNING nova.compute.manager [req-b01bdeb1-fa22-4c0e-b5f2-5eff54890da5 req-fbf71483-22da-49f1-97e2-a4f4d1be5ae5 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state active and task_state rescuing.
Oct 20 11:37:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:26 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance destroyed successfully.
Oct 20 11:37:26 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Attempting a stable device rescue
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance directory exists: not creating {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 11:37:26 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Creating image(s)
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.objects.instance [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'trusted_certs' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1971afda-04cd-468f-b671-9ab3fd2111cb req-de4b4617-e67b-4be8-a88f-7152668e101f service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received event network-vif-unplugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1971afda-04cd-468f-b671-9ab3fd2111cb req-de4b4617-e67b-4be8-a88f-7152668e101f service nova] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1971afda-04cd-468f-b671-9ab3fd2111cb req-de4b4617-e67b-4be8-a88f-7152668e101f service nova] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1971afda-04cd-468f-b671-9ab3fd2111cb req-de4b4617-e67b-4be8-a88f-7152668e101f service nova] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1971afda-04cd-468f-b671-9ab3fd2111cb req-de4b4617-e67b-4be8-a88f-7152668e101f service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] No waiting events found dispatching network-vif-unplugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-1971afda-04cd-468f-b671-9ab3fd2111cb req-de4b4617-e67b-4be8-a88f-7152668e101f service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received event network-vif-unplugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:27 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Instance destroyed successfully.
Oct 20 11:37:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lazy-loading 'resources' on Instance uuid d128bb7d-42b2-4d1a-94c0-de749ec2235c {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-456613760',display_name='tempest-AttachSCSIVolumeTestJSON-server-456613760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-456613760',id=6,image_ref='5a4f8dbd-af62-4496-b722-68ff8e23ec40',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFX+31qGde1ohA+BDv3a3O7nbNRN/SypZiXsuCkQRb0HnqSD+gtbODzj/4kUcL70xM946MYFHACGylKMm0H2f75w5P6ilp9uv6hYL6Ux4LTyqGzWRE6Elpprp1b2afFNKg==',key_name='tempest-keypair-1211747481',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb36380f186a45329b824553df3d4802',ramdisk_id='',reservation_id='r-jcdzb6z2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5a4f8dbd-af62-4496-b722-68ff8e23ec40',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1995034066',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1995034066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fc7a643b6dac4d7899775dabdae45a05',uuid=d128bb7d-42b2-4d1a-94c0-de749ec2235c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Converting VIF {"id": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "address": "fa:16:3e:6e:5b:82", "network": {"id": "867c06f4-3caf-45bc-982a-06123e68f852", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-66498216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb36380f186a45329b824553df3d4802", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ddf1fc-cd", "ovs_interfaceid": "f0ddf1fc-cdd1-44a5-96a6-afc986e60c34", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5b:82,bridge_name='br-int',has_traffic_filtering=True,id=f0ddf1fc-cdd1-44a5-96a6-afc986e60c34,network=Network(867c06f4-3caf-45bc-982a-06123e68f852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ddf1fc-cd') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG os_vif [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5b:82,bridge_name='br-int',has_traffic_filtering=True,id=f0ddf1fc-cdd1-44a5-96a6-afc986e60c34,network=Network(867c06f4-3caf-45bc-982a-06123e68f852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ddf1fc-cd') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0ddf1fc-cd, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d59617a0-8644-422e-85b4-b216cb75309f) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:28 user nova-compute[74241]: INFO os_vif [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:5b:82,bridge_name='br-int',has_traffic_filtering=True,id=f0ddf1fc-cdd1-44a5-96a6-afc986e60c34,network=Network(867c06f4-3caf-45bc-982a-06123e68f852),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ddf1fc-cd')
Oct 20 11:37:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Deleting instance files /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c_del
Oct 20 11:37:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Deletion of /opt/stack/data/nova/instances/d128bb7d-42b2-4d1a-94c0-de749ec2235c_del complete
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874.part --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.virt.images [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] 4d61c2ee-f903-43a1-acf5-365b9f6e404b was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874.part /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:28 user nova-compute[74241]: INFO nova.compute.manager [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Took 1.87 seconds to destroy the instance on the hypervisor.
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874.part /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874.converted" returned: 0 in 0.412s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-78ea3e48-b6f8-4df3-898a-a5091796febf req-5ae4985c-4d04-4d8b-bbe5-3937211a6de1 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78ea3e48-b6f8-4df3-898a-a5091796febf req-5ae4985c-4d04-4d8b-bbe5-3937211a6de1 service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78ea3e48-b6f8-4df3-898a-a5091796febf req-5ae4985c-4d04-4d8b-bbe5-3937211a6de1 service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78ea3e48-b6f8-4df3-898a-a5091796febf req-5ae4985c-4d04-4d8b-bbe5-3937211a6de1 service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-78ea3e48-b6f8-4df3-898a-a5091796febf req-5ae4985c-4d04-4d8b-bbe5-3937211a6de1 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:28 user nova-compute[74241]: WARNING nova.compute.manager [req-78ea3e48-b6f8-4df3-898a-a5091796febf req-5ae4985c-4d04-4d8b-bbe5-3937211a6de1 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state active and task_state rescuing.
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.928s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874 --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874,backing_fmt=raw /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-0b2349af-bc19-44f2-87c6-5789d9fc093a req-8330d65b-16d2-477a-934d-e2dee23a08d2 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received event network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b2349af-bc19-44f2-87c6-5789d9fc093a req-8330d65b-16d2-477a-934d-e2dee23a08d2 service nova] Acquiring lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b2349af-bc19-44f2-87c6-5789d9fc093a req-8330d65b-16d2-477a-934d-e2dee23a08d2 service nova] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b2349af-bc19-44f2-87c6-5789d9fc093a req-8330d65b-16d2-477a-934d-e2dee23a08d2 service nova] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-0b2349af-bc19-44f2-87c6-5789d9fc093a req-8330d65b-16d2-477a-934d-e2dee23a08d2 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] No waiting events found dispatching network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:28 user nova-compute[74241]: WARNING nova.compute.manager [req-0b2349af-bc19-44f2-87c6-5789d9fc093a req-8330d65b-16d2-477a-934d-e2dee23a08d2 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received unexpected event network-vif-plugged-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 for instance with vm_state active and task_state deleting.
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874,backing_fmt=raw /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue" returned: 0 in 0.076s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:28 user nova-compute[74241]: DEBUG nova.objects.instance [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'migration_context' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Object Instance<95bf8c4c-21a0-462c-a370-eedd74d6fc1a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Start _get_guest_xml network_info=[{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "vif_mac": "fa:16:3e:00:c5:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4d61c2ee-f903-43a1-acf5-365b9f6e404b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '27bde60e-aece-457e-bf4c-33a16bb289f8', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnCSkuNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '95bf8c4c-21a0-462c-a370-eedd74d6fc1a', 'attached_at': '', 'detached_at': '', 'volume_id': '55d0f928-afff-41a0-b970-021ed8f154b6', 'serial': '55d0f928-afff-41a0-b970-021ed8f154b6'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.instance [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'resources' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Object Instance<95bf8c4c-21a0-462c-a370-eedd74d6fc1a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.instance [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'numa_topology' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Object Instance<95bf8c4c-21a0-462c-a370-eedd74d6fc1a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:37:29 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:37:29 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.instance [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'vcpu_model' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Object Instance<95bf8c4c-21a0-462c-a370-eedd74d6fc1a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnCSkuNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:29 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:29 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:29 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c5e16c-42fd-4bc3-aabd-4edcf9be63d7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BnCSkuNm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 11:37:29 user nova-compute[74241]: node.name = iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:37:29 user nova-compute[74241]: node.tpgt = -1
Oct 20 11:37:29 user nova-compute[74241]: node.startup = automatic
Oct 20 11:37:29 user nova-compute[74241]: node.leading_login = No
Oct 20 11:37:29 user nova-compute[74241]: iface.iscsi_ifacename = default
Oct 20 11:37:29 user nova-compute[74241]: iface.net_ifacename = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.ipaddress = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.prefix_len = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.hwaddress = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.transport_name = tcp
Oct 20 11:37:29 user nova-compute[74241]: iface.initiatorname = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.state = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.vlan_id = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.vlan_priority = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.vlan_state = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.iface_num = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.mtu = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.port = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.bootproto = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.subnet_mask = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.gateway = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.dhcp_alt_client_id = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.dhcp_dns = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.dhcp_learn_iqn = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.dhcp_vendor_id_state = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.dhcp_vendor_id = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.dhcp_slp_da = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.fragmentation = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.gratuitous_arp = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.incoming_forwarding = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.tos_state = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.tos = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.ttl = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.delayed_ack = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.tcp_nagle = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.tcp_wsf_state = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.tcp_wsf = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.tcp_timer_scale = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.tcp_timestamp = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.redirect = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.def_task_mgmt_timeout = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.header_digest = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.data_digest = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.immediate_data = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.initial_r2t = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.data_seq_inorder = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.data_pdu_inorder = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.erl = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.max_receive_data_len = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.first_burst_len = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.max_outstanding_r2t = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.max_burst_len = 0
Oct 20 11:37:29 user nova-compute[74241]: iface.chap_auth = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.bidi_chap = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.strict_login_compliance = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.discovery_auth = <empty>
Oct 20 11:37:29 user nova-compute[74241]: iface.discovery_logout = <empty>
Oct 20 11:37:29 user nova-compute[74241]: node.discovery_address = <empty>
Oct 20 11:37:29 user nova-compute[74241]: node.discovery_port = 0
Oct 20 11:37:29 user nova-compute[74241]: node.discovery_type = static
Oct 20 11:37:29 user nova-compute[74241]: node.session.initial_cmdsn = 0
Oct 20 11:37:29 user nova-compute[74241]: node.session.initial_login_retry_max = 8
Oct 20 11:37:29 user nova-compute[74241]: node.session.xmit_thread_priority = -20
Oct 20 11:37:29 user nova-compute[74241]: node.session.cmds_max = 128
Oct 20 11:37:29 user nova-compute[74241]: node.session.queue_depth = 32
Oct 20 11:37:29 user nova-compute[74241]: node.session.nr_sessions = 1
Oct 20 11:37:29 user nova-compute[74241]: node.session.auth.authmethod = CHAP
Oct 20 11:37:29 user nova-compute[74241]: node.session.auth.username = BnCSkuNm
Oct 20 11:37:29 user nova-compute[74241]: node.session.auth.password = ***
Oct 20 11:37:29 user nova-compute[74241]: node.session.auth.username_in = <empty>
Oct 20 11:37:29 user nova-compute[74241]: node.session.auth.password_in = <empty>
Oct 20 11:37:29 user nova-compute[74241]: node.session.auth.chap_algs = MD5
Oct 20 11:37:29 user nova-compute[74241]: node.session.timeo.replacement_timeout = 120
Oct 20 11:37:29 user nova-compute[74241]: node.session.err_timeo.abort_timeout = 15
Oct 20 11:37:29 user nova-compute[74241]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 11:37:29 user nova-compute[74241]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 11:37:29 user nova-compute[74241]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.FastAbort = Yes
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.InitialR2T = No
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.ImmediateData = Yes
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.MaxConnections = 1
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 11:37:29 user nova-compute[74241]: node.session.iscsi.ERL = 0
Oct 20 11:37:29 user nova-compute[74241]: node.session.scan = manual
Oct 20 11:37:29 user nova-compute[74241]: node.session.reopen_max = 0
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].address = 172.16.0.220
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].port = 3260
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].startup = manual
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].tcp.window_size = 524288
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].tcp.type_of_service = 0
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].timeo.logout_timeout = 15
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].timeo.login_timeout = 15
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].timeo.auth_timeout = 45
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].iscsi.DataDigest = None
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].iscsi.IFMarker = No
Oct 20 11:37:29 user nova-compute[74241]: node.conn[0].iscsi.OFMarker = No
Oct 20 11:37:29 user nova-compute[74241]: # END RECORD
Oct 20 11:37:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0eac44-7956-4300-ae5f-8d2e5e89342f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67b4b47-98ab-4c66-9be9-c90b539e621e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnCSkuNm {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BnCSkuNm" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d75f0-7ceb-4e26-bb32-6d1f71a4353a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BnCSkuNm'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[642cc4ac-40f0-4631-9549-dd530c796a38]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bf7739-507f-4ac2-9eb7-cae288e77f5f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:29 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:29 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:29 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:29 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:29 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:29 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:29 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:29 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.199s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] HCTL ('35', '0', '0', 0) found on session 13 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07662df-58c4-4a1c-83ed-111b6ecd0ba0]: (4, ('0 0 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Searching for a device in session 13 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnCSkuNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.226s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] <== connect_volume: return (228ms) {'type': 'block', 'scsi_wwn': '26164376666306430', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164376666306430', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:37:29 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Took 1.27 seconds to deallocate network for instance.
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-219899213',display_name='tempest-ServerStableDeviceRescueTest-server-219899213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-219899213',id=2,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/8WymVPDZxC9KfamWkU3H/nL3X9qJvU0cXONDpPlPtSbxrjqFJcKqA3LzbbDd//Q5fsnFeST6x7AHiBg7Md+G2s/LPWp5PU8eojSD2lO8Rz/5kZbTFOa0zvXzgC4RVLQ==',key_name='tempest-keypair-1870905534',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='948a6489aae6437cbcfbcd73857caa81',ramdisk_id='',reservation_id='r-z37qlkwv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-89486859',owner_user_name='tempest-ServerStableDeviceRescueTest-89486859-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:34:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43687383ff994fc5bea21a588209bf30',uuid=95bf8c4c-21a0-462c-a370-eedd74d6fc1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "vif_mac": "fa:16:3e:00:c5:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Converting VIF {"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "vif_mac": "fa:16:3e:00:c5:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=08303d9d-06cf-4e8a-a348-f1475340cb3c,network=Network(c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08303d9d-06') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.instance [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'pci_devices' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.objects.base [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Object Instance<95bf8c4c-21a0-462c-a370-eedd74d6fc1a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:37:29 user nova-compute[74241]:   <uuid>95bf8c4c-21a0-462c-a370-eedd74d6fc1a</uuid>
Oct 20 11:37:29 user nova-compute[74241]:   <name>instance-00000002</name>
Oct 20 11:37:29 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:37:29 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:37:29 user nova-compute[74241]:   <metadata>
Oct 20 11:37:29 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:29 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:37:29 user nova-compute[74241]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-219899213</nova:name>
Oct 20 11:37:29 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:37:29</nova:creationTime>
Oct 20 11:37:29 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:37:29 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:37:29 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:37:29 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:37:29 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:29 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:29 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:37:29 user nova-compute[74241]:       <nova:owner>
Oct 20 11:37:29 user nova-compute[74241]:         <nova:user uuid="43687383ff994fc5bea21a588209bf30">tempest-ServerStableDeviceRescueTest-89486859-project-member</nova:user>
Oct 20 11:37:29 user nova-compute[74241]:         <nova:project uuid="948a6489aae6437cbcfbcd73857caa81">tempest-ServerStableDeviceRescueTest-89486859</nova:project>
Oct 20 11:37:29 user nova-compute[74241]:       </nova:owner>
Oct 20 11:37:29 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:29 user nova-compute[74241]:       <nova:ports>
Oct 20 11:37:29 user nova-compute[74241]:         <nova:port uuid="08303d9d-06cf-4e8a-a348-f1475340cb3c">
Oct 20 11:37:29 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 11:37:29 user nova-compute[74241]:         </nova:port>
Oct 20 11:37:29 user nova-compute[74241]:       </nova:ports>
Oct 20 11:37:29 user nova-compute[74241]:     </nova:instance>
Oct 20 11:37:29 user nova-compute[74241]:   </metadata>
Oct 20 11:37:29 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:37:29 user nova-compute[74241]:     <system>
Oct 20 11:37:29 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:37:29 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:37:29 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:37:29 user nova-compute[74241]:       <entry name="serial">95bf8c4c-21a0-462c-a370-eedd74d6fc1a</entry>
Oct 20 11:37:29 user nova-compute[74241]:       <entry name="uuid">95bf8c4c-21a0-462c-a370-eedd74d6fc1a</entry>
Oct 20 11:37:29 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:37:29 user nova-compute[74241]:     </system>
Oct 20 11:37:29 user nova-compute[74241]:   </sysinfo>
Oct 20 11:37:29 user nova-compute[74241]:   <os>
Oct 20 11:37:29 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:37:29 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:37:29 user nova-compute[74241]:   </os>
Oct 20 11:37:29 user nova-compute[74241]:   <features>
Oct 20 11:37:29 user nova-compute[74241]:     <acpi/>
Oct 20 11:37:29 user nova-compute[74241]:     <apic/>
Oct 20 11:37:29 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:37:29 user nova-compute[74241]:   </features>
Oct 20 11:37:29 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:37:29 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:37:29 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:37:29 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:37:29 user nova-compute[74241]:   </clock>
Oct 20 11:37:29 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:37:29 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:37:29 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:37:29 user nova-compute[74241]:   </cpu>
Oct 20 11:37:29 user nova-compute[74241]:   <devices>
Oct 20 11:37:29 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:37:29 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:37:29 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk"/>
Oct 20 11:37:29 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:37:29 user nova-compute[74241]:     </disk>
Oct 20 11:37:29 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:37:29 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:37:29 user nova-compute[74241]:       <source dev="/dev/sdd"/>
Oct 20 11:37:29 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:37:29 user nova-compute[74241]:       <serial>55d0f928-afff-41a0-b970-021ed8f154b6</serial>
Oct 20 11:37:29 user nova-compute[74241]:     </disk>
Oct 20 11:37:29 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:37:29 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:37:29 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue"/>
Oct 20 11:37:29 user nova-compute[74241]:       <target dev="vdc" bus="virtio"/>
Oct 20 11:37:29 user nova-compute[74241]:       <boot order="1"/>
Oct 20 11:37:29 user nova-compute[74241]:     </disk>
Oct 20 11:37:29 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:37:29 user nova-compute[74241]:       <mac address="fa:16:3e:00:c5:3e"/>
Oct 20 11:37:29 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:37:29 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:37:29 user nova-compute[74241]:       <target dev="tap08303d9d-06"/>
Oct 20 11:37:29 user nova-compute[74241]:     </interface>
Oct 20 11:37:29 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:37:29 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/console.log" append="off"/>
Oct 20 11:37:29 user nova-compute[74241]:     </serial>
Oct 20 11:37:29 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:37:29 user nova-compute[74241]:     <video>
Oct 20 11:37:29 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:37:29 user nova-compute[74241]:     </video>
Oct 20 11:37:29 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:37:29 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:37:29 user nova-compute[74241]:     </rng>
Oct 20 11:37:29 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:37:29 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:37:29 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:37:29 user nova-compute[74241]:     </memballoon>
Oct 20 11:37:29 user nova-compute[74241]:   </devices>
Oct 20 11:37:29 user nova-compute[74241]: </domain>
Oct 20 11:37:29 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance destroyed successfully.
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] No VIF found with MAC fa:16:3e:00:c5:3e, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:37:29 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:37:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.519s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:30 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Deleted allocations for instance d128bb7d-42b2-4d1a-94c0-de749ec2235c
Oct 20 11:37:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d44ccddd-a340-43da-a31c-d3796ced6523 tempest-AttachSCSIVolumeTestJSON-1995034066 tempest-AttachSCSIVolumeTestJSON-1995034066-project-member] Lock "d128bb7d-42b2-4d1a-94c0-de749ec2235c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.932s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:30 user nova-compute[74241]: INFO nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Took 5.96 seconds to deallocate network for instance.
Oct 20 11:37:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Detaching volume: 33855670-3ed6-49b6-8476-289acdfd3483 {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 20 11:37:30 user nova-compute[74241]: INFO nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Detaching volume 33855670-3ed6-49b6-8476-289acdfd3483
Oct 20 11:37:30 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Skipping driver_detach during remote rebuild. {{(pid=74241) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 20 11:37:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c8188b6-fc67-4fd6-ab9c-eebcead75956 req-28573d27-f424-4f93-bdc2-97e2ace553e6 service nova] [instance: d128bb7d-42b2-4d1a-94c0-de749ec2235c] Received event network-vif-deleted-f0ddf1fc-cdd1-44a5-96a6-afc986e60c34 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:32 user nova-compute[74241]: WARNING nova.compute.manager [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state active and task_state rescuing.
Oct 20 11:37:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:32 user nova-compute[74241]: WARNING nova.compute.manager [req-c1c1b0ce-5976-4432-8e09-5a705176e91c req-df0fa3f8-32b2-4b0f-8d14-10901dab764b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state active and task_state rescuing.
Oct 20 11:37:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-32a8b436-82bb-453e-ae1f-dd75b21c7c17 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:37:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:43 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Waiting for libvirt event about the detach of device tap2348d99b-d4 with device alias net1 from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 is timed out.
Oct 20 11:37:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface> {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 11:37:43 user nova-compute[74241]:   <name>instance-00000007</name>
Oct 20 11:37:43 user nova-compute[74241]:   <uuid>726a7f29-03b0-489f-a77d-9a77e5c4a546</uuid>
Oct 20 11:37:43 user nova-compute[74241]:   <metadata>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:43 user nova-compute[74241]:   <nova:package version="0.0.0"/>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:name>tempest-device-tagging-server-1761481514</nova:name>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:creationTime>2023-10-20 11:35:26</nova:creationTime>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:flavor name="m1.tiny">
Oct 20 11:37:43 user nova-compute[74241]:     <nova:memory>512</nova:memory>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:disk>1</nova:disk>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:swap>0</nova:swap>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:43 user nova-compute[74241]:   </nova:flavor>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:owner>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:user uuid="16555d6cef90422db4c851511083a34f">tempest-TaggedAttachmentsTest-20080626-project-member</nova:user>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:project uuid="ccb28511a3ff4f30bffdd7c8aa870c39">tempest-TaggedAttachmentsTest-20080626</nova:project>
Oct 20 11:37:43 user nova-compute[74241]:   </nova:owner>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:ports>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:port uuid="88fde83f-c742-460e-8d1a-78982cbb685e">
Oct 20 11:37:43 user nova-compute[74241]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:37:43 user nova-compute[74241]:     </nova:port>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:port uuid="2348d99b-d4b3-4938-ab06-ab5aa38e5116">
Oct 20 11:37:43 user nova-compute[74241]:       <nova:ip type="fixed" address="10.10.10.57" ipVersion="4"/>
Oct 20 11:37:43 user nova-compute[74241]:     </nova:port>
Oct 20 11:37:43 user nova-compute[74241]:   </nova:ports>
Oct 20 11:37:43 user nova-compute[74241]: </nova:instance>
Oct 20 11:37:43 user nova-compute[74241]:   </metadata>
Oct 20 11:37:43 user nova-compute[74241]:   <memory unit='KiB'>524288</memory>
Oct 20 11:37:43 user nova-compute[74241]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 11:37:43 user nova-compute[74241]:   <vcpu placement='static'>1</vcpu>
Oct 20 11:37:43 user nova-compute[74241]:   <resource>
Oct 20 11:37:43 user nova-compute[74241]:     <partition>/machine</partition>
Oct 20 11:37:43 user nova-compute[74241]:   </resource>
Oct 20 11:37:43 user nova-compute[74241]:   <sysinfo type='smbios'>
Oct 20 11:37:43 user nova-compute[74241]:     <system>
Oct 20 11:37:43 user nova-compute[74241]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 11:37:43 user nova-compute[74241]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 11:37:43 user nova-compute[74241]:       <entry name='version'>0.0.0</entry>
Oct 20 11:37:43 user nova-compute[74241]:       <entry name='serial'>726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:37:43 user nova-compute[74241]:       <entry name='uuid'>726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:37:43 user nova-compute[74241]:       <entry name='family'>Virtual Machine</entry>
Oct 20 11:37:43 user nova-compute[74241]:     </system>
Oct 20 11:37:43 user nova-compute[74241]:   </sysinfo>
Oct 20 11:37:43 user nova-compute[74241]:   <os>
Oct 20 11:37:43 user nova-compute[74241]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 11:37:43 user nova-compute[74241]:     <boot dev='hd'/>
Oct 20 11:37:43 user nova-compute[74241]:     <smbios mode='sysinfo'/>
Oct 20 11:37:43 user nova-compute[74241]:   </os>
Oct 20 11:37:43 user nova-compute[74241]:   <features>
Oct 20 11:37:43 user nova-compute[74241]:     <acpi/>
Oct 20 11:37:43 user nova-compute[74241]:     <apic/>
Oct 20 11:37:43 user nova-compute[74241]:     <vmcoreinfo state='on'/>
Oct 20 11:37:43 user nova-compute[74241]:   </features>
Oct 20 11:37:43 user nova-compute[74241]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 11:37:43 user nova-compute[74241]:     <model fallback='forbid'>Nehalem</model>
Oct 20 11:37:43 user nova-compute[74241]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 11:37:43 user nova-compute[74241]:     <feature policy='require' name='vme'/>
Oct 20 11:37:43 user nova-compute[74241]:     <feature policy='require' name='x2apic'/>
Oct 20 11:37:43 user nova-compute[74241]:     <feature policy='require' name='hypervisor'/>
Oct 20 11:37:43 user nova-compute[74241]:   </cpu>
Oct 20 11:37:43 user nova-compute[74241]:   <clock offset='utc'>
Oct 20 11:37:43 user nova-compute[74241]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 11:37:43 user nova-compute[74241]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 11:37:43 user nova-compute[74241]:     <timer name='hpet' present='no'/>
Oct 20 11:37:43 user nova-compute[74241]:   </clock>
Oct 20 11:37:43 user nova-compute[74241]:   <on_poweroff>destroy</on_poweroff>
Oct 20 11:37:43 user nova-compute[74241]:   <on_reboot>restart</on_reboot>
Oct 20 11:37:43 user nova-compute[74241]:   <on_crash>destroy</on_crash>
Oct 20 11:37:43 user nova-compute[74241]:   <devices>
Oct 20 11:37:43 user nova-compute[74241]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 11:37:43 user nova-compute[74241]:     <disk type='file' device='disk'>
Oct 20 11:37:43 user nova-compute[74241]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 11:37:43 user nova-compute[74241]:       <source file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk' index='2'/>
Oct 20 11:37:43 user nova-compute[74241]:       <backingStore type='file' index='3'>
Oct 20 11:37:43 user nova-compute[74241]:         <format type='raw'/>
Oct 20 11:37:43 user nova-compute[74241]:         <source file='/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555'/>
Oct 20 11:37:43 user nova-compute[74241]:         <backingStore/>
Oct 20 11:37:43 user nova-compute[74241]:       </backingStore>
Oct 20 11:37:43 user nova-compute[74241]:       <target dev='vda' bus='virtio'/>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='virtio-disk0'/>
Oct 20 11:37:43 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </disk>
Oct 20 11:37:43 user nova-compute[74241]:     <disk type='file' device='cdrom'>
Oct 20 11:37:43 user nova-compute[74241]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 11:37:43 user nova-compute[74241]:       <source file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.config' index='1'/>
Oct 20 11:37:43 user nova-compute[74241]:       <backingStore/>
Oct 20 11:37:43 user nova-compute[74241]:       <target dev='hda' bus='ide'/>
Oct 20 11:37:43 user nova-compute[74241]:       <readonly/>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='ide0-0-0'/>
Oct 20 11:37:43 user nova-compute[74241]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </disk>
Oct 20 11:37:43 user nova-compute[74241]:     <controller type='usb' index='0' model='none'>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='usb'/>
Oct 20 11:37:43 user nova-compute[74241]:     </controller>
Oct 20 11:37:43 user nova-compute[74241]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='pci.0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </controller>
Oct 20 11:37:43 user nova-compute[74241]:     <controller type='ide' index='0'>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='ide'/>
Oct 20 11:37:43 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 11:37:43 user nova-compute[74241]:     </controller>
Oct 20 11:37:43 user nova-compute[74241]:     <interface type='ethernet'>
Oct 20 11:37:43 user nova-compute[74241]:       <mac address='fa:16:3e:ae:a1:83'/>
Oct 20 11:37:43 user nova-compute[74241]:       <target dev='tap88fde83f-c7'/>
Oct 20 11:37:43 user nova-compute[74241]:       <model type='virtio'/>
Oct 20 11:37:43 user nova-compute[74241]:       <mtu size='1442'/>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='net0'/>
Oct 20 11:37:43 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </interface>
Oct 20 11:37:43 user nova-compute[74241]:     <serial type='pty'>
Oct 20 11:37:43 user nova-compute[74241]:       <source path='/dev/pts/6'/>
Oct 20 11:37:43 user nova-compute[74241]:       <log file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log' append='off'/>
Oct 20 11:37:43 user nova-compute[74241]:       <target type='isa-serial' port='0'>
Oct 20 11:37:43 user nova-compute[74241]:         <model name='isa-serial'/>
Oct 20 11:37:43 user nova-compute[74241]:       </target>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='serial0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </serial>
Oct 20 11:37:43 user nova-compute[74241]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 11:37:43 user nova-compute[74241]:       <source path='/dev/pts/6'/>
Oct 20 11:37:43 user nova-compute[74241]:       <log file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log' append='off'/>
Oct 20 11:37:43 user nova-compute[74241]:       <target type='serial' port='0'/>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='serial0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </console>
Oct 20 11:37:43 user nova-compute[74241]:     <input type='mouse' bus='ps2'>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='input0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </input>
Oct 20 11:37:43 user nova-compute[74241]:     <input type='keyboard' bus='ps2'>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='input1'/>
Oct 20 11:37:43 user nova-compute[74241]:     </input>
Oct 20 11:37:43 user nova-compute[74241]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 11:37:43 user nova-compute[74241]:       <listen type='address' address='0.0.0.0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </graphics>
Oct 20 11:37:43 user nova-compute[74241]:     <audio id='1' type='none'/>
Oct 20 11:37:43 user nova-compute[74241]:     <video>
Oct 20 11:37:43 user nova-compute[74241]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='video0'/>
Oct 20 11:37:43 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </video>
Oct 20 11:37:43 user nova-compute[74241]:     <memballoon model='virtio'>
Oct 20 11:37:43 user nova-compute[74241]:       <stats period='10'/>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='balloon0'/>
Oct 20 11:37:43 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </memballoon>
Oct 20 11:37:43 user nova-compute[74241]:     <rng model='virtio'>
Oct 20 11:37:43 user nova-compute[74241]:       <backend model='random'>/dev/urandom</backend>
Oct 20 11:37:43 user nova-compute[74241]:       <alias name='rng0'/>
Oct 20 11:37:43 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 11:37:43 user nova-compute[74241]:     </rng>
Oct 20 11:37:43 user nova-compute[74241]:   </devices>
Oct 20 11:37:43 user nova-compute[74241]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 11:37:43 user nova-compute[74241]:     <label>libvirt-726a7f29-03b0-489f-a77d-9a77e5c4a546</label>
Oct 20 11:37:43 user nova-compute[74241]:     <imagelabel>libvirt-726a7f29-03b0-489f-a77d-9a77e5c4a546</imagelabel>
Oct 20 11:37:43 user nova-compute[74241]:   </seclabel>
Oct 20 11:37:43 user nova-compute[74241]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 11:37:43 user nova-compute[74241]:     <label>+64055:+108</label>
Oct 20 11:37:43 user nova-compute[74241]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 11:37:43 user nova-compute[74241]:   </seclabel>
Oct 20 11:37:43 user nova-compute[74241]: </domain>
Oct 20 11:37:43 user nova-compute[74241]:  {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 11:37:43 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Successfully detached device tap2348d99b-d4 from instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 from the live domain config.
Oct 20 11:37:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converting VIF {"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG os_vif [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2348d99b-d4, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58bc6ba8-1c65-4cdd-9b12-0df537f1ed78) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:43 user nova-compute[74241]: INFO os_vif [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4')
Oct 20 11:37:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:43 user nova-compute[74241]:   <nova:package version="0.0.0"/>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:name>tempest-device-tagging-server-1761481514</nova:name>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:creationTime>2023-10-20 11:37:43</nova:creationTime>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:flavor name="m1.tiny">
Oct 20 11:37:43 user nova-compute[74241]:     <nova:memory>512</nova:memory>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:disk>1</nova:disk>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:swap>0</nova:swap>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:43 user nova-compute[74241]:   </nova:flavor>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:owner>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:user uuid="16555d6cef90422db4c851511083a34f">tempest-TaggedAttachmentsTest-20080626-project-member</nova:user>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:project uuid="ccb28511a3ff4f30bffdd7c8aa870c39">tempest-TaggedAttachmentsTest-20080626</nova:project>
Oct 20 11:37:43 user nova-compute[74241]:   </nova:owner>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:43 user nova-compute[74241]:   <nova:ports>
Oct 20 11:37:43 user nova-compute[74241]:     <nova:port uuid="88fde83f-c742-460e-8d1a-78982cbb685e">
Oct 20 11:37:43 user nova-compute[74241]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:37:43 user nova-compute[74241]:     </nova:port>
Oct 20 11:37:43 user nova-compute[74241]:   </nova:ports>
Oct 20 11:37:43 user nova-compute[74241]: </nova:instance>
Oct 20 11:37:43 user nova-compute[74241]:  {{(pid=74241) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-deleted-2348d99b-d4b3-4938-ab06-ab5aa38e5116 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:45 user nova-compute[74241]: INFO nova.compute.manager [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Neutron deleted interface 2348d99b-d4b3-4938-ab06-ab5aa38e5116; detaching it from the instance and deleting it from the info cache
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.network.neutron [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating instance_info_cache with network_info: [{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquired lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.network.neutron [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.objects.instance [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Lazy-loading 'system_metadata' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.objects.instance [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Lazy-loading 'flavor' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.objects.base [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Object Instance<726a7f29-03b0-489f-a77d-9a77e5c4a546> lazy-loaded attributes: system_metadata,flavor {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Converting VIF {"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface> {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 11:37:45 user nova-compute[74241]:   <name>instance-00000007</name>
Oct 20 11:37:45 user nova-compute[74241]:   <uuid>726a7f29-03b0-489f-a77d-9a77e5c4a546</uuid>
Oct 20 11:37:45 user nova-compute[74241]:   <metadata>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:45 user nova-compute[74241]:   <nova:package version="0.0.0"/>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:name>tempest-device-tagging-server-1761481514</nova:name>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:creationTime>2023-10-20 11:37:43</nova:creationTime>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:flavor name="m1.tiny">
Oct 20 11:37:45 user nova-compute[74241]:     <nova:memory>512</nova:memory>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:disk>1</nova:disk>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:swap>0</nova:swap>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:flavor>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:owner>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:user uuid="16555d6cef90422db4c851511083a34f">tempest-TaggedAttachmentsTest-20080626-project-member</nova:user>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:project uuid="ccb28511a3ff4f30bffdd7c8aa870c39">tempest-TaggedAttachmentsTest-20080626</nova:project>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:owner>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:ports>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:port uuid="88fde83f-c742-460e-8d1a-78982cbb685e">
Oct 20 11:37:45 user nova-compute[74241]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:37:45 user nova-compute[74241]:     </nova:port>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:ports>
Oct 20 11:37:45 user nova-compute[74241]: </nova:instance>
Oct 20 11:37:45 user nova-compute[74241]:   </metadata>
Oct 20 11:37:45 user nova-compute[74241]:   <memory unit='KiB'>524288</memory>
Oct 20 11:37:45 user nova-compute[74241]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 11:37:45 user nova-compute[74241]:   <vcpu placement='static'>1</vcpu>
Oct 20 11:37:45 user nova-compute[74241]:   <resource>
Oct 20 11:37:45 user nova-compute[74241]:     <partition>/machine</partition>
Oct 20 11:37:45 user nova-compute[74241]:   </resource>
Oct 20 11:37:45 user nova-compute[74241]:   <sysinfo type='smbios'>
Oct 20 11:37:45 user nova-compute[74241]:     <system>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='version'>0.0.0</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='serial'>726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='uuid'>726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='family'>Virtual Machine</entry>
Oct 20 11:37:45 user nova-compute[74241]:     </system>
Oct 20 11:37:45 user nova-compute[74241]:   </sysinfo>
Oct 20 11:37:45 user nova-compute[74241]:   <os>
Oct 20 11:37:45 user nova-compute[74241]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 11:37:45 user nova-compute[74241]:     <boot dev='hd'/>
Oct 20 11:37:45 user nova-compute[74241]:     <smbios mode='sysinfo'/>
Oct 20 11:37:45 user nova-compute[74241]:   </os>
Oct 20 11:37:45 user nova-compute[74241]:   <features>
Oct 20 11:37:45 user nova-compute[74241]:     <acpi/>
Oct 20 11:37:45 user nova-compute[74241]:     <apic/>
Oct 20 11:37:45 user nova-compute[74241]:     <vmcoreinfo state='on'/>
Oct 20 11:37:45 user nova-compute[74241]:   </features>
Oct 20 11:37:45 user nova-compute[74241]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 11:37:45 user nova-compute[74241]:     <model fallback='forbid'>Nehalem</model>
Oct 20 11:37:45 user nova-compute[74241]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 11:37:45 user nova-compute[74241]:     <feature policy='require' name='vme'/>
Oct 20 11:37:45 user nova-compute[74241]:     <feature policy='require' name='x2apic'/>
Oct 20 11:37:45 user nova-compute[74241]:     <feature policy='require' name='hypervisor'/>
Oct 20 11:37:45 user nova-compute[74241]:   </cpu>
Oct 20 11:37:45 user nova-compute[74241]:   <clock offset='utc'>
Oct 20 11:37:45 user nova-compute[74241]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 11:37:45 user nova-compute[74241]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 11:37:45 user nova-compute[74241]:     <timer name='hpet' present='no'/>
Oct 20 11:37:45 user nova-compute[74241]:   </clock>
Oct 20 11:37:45 user nova-compute[74241]:   <on_poweroff>destroy</on_poweroff>
Oct 20 11:37:45 user nova-compute[74241]:   <on_reboot>restart</on_reboot>
Oct 20 11:37:45 user nova-compute[74241]:   <on_crash>destroy</on_crash>
Oct 20 11:37:45 user nova-compute[74241]:   <devices>
Oct 20 11:37:45 user nova-compute[74241]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 11:37:45 user nova-compute[74241]:     <disk type='file' device='disk'>
Oct 20 11:37:45 user nova-compute[74241]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 11:37:45 user nova-compute[74241]:       <source file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk' index='2'/>
Oct 20 11:37:45 user nova-compute[74241]:       <backingStore type='file' index='3'>
Oct 20 11:37:45 user nova-compute[74241]:         <format type='raw'/>
Oct 20 11:37:45 user nova-compute[74241]:         <source file='/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555'/>
Oct 20 11:37:45 user nova-compute[74241]:         <backingStore/>
Oct 20 11:37:45 user nova-compute[74241]:       </backingStore>
Oct 20 11:37:45 user nova-compute[74241]:       <target dev='vda' bus='virtio'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='virtio-disk0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </disk>
Oct 20 11:37:45 user nova-compute[74241]:     <disk type='file' device='cdrom'>
Oct 20 11:37:45 user nova-compute[74241]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 11:37:45 user nova-compute[74241]:       <source file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.config' index='1'/>
Oct 20 11:37:45 user nova-compute[74241]:       <backingStore/>
Oct 20 11:37:45 user nova-compute[74241]:       <target dev='hda' bus='ide'/>
Oct 20 11:37:45 user nova-compute[74241]:       <readonly/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='ide0-0-0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </disk>
Oct 20 11:37:45 user nova-compute[74241]:     <controller type='usb' index='0' model='none'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='usb'/>
Oct 20 11:37:45 user nova-compute[74241]:     </controller>
Oct 20 11:37:45 user nova-compute[74241]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='pci.0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </controller>
Oct 20 11:37:45 user nova-compute[74241]:     <controller type='ide' index='0'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='ide'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 11:37:45 user nova-compute[74241]:     </controller>
Oct 20 11:37:45 user nova-compute[74241]:     <interface type='ethernet'>
Oct 20 11:37:45 user nova-compute[74241]:       <mac address='fa:16:3e:ae:a1:83'/>
Oct 20 11:37:45 user nova-compute[74241]:       <target dev='tap88fde83f-c7'/>
Oct 20 11:37:45 user nova-compute[74241]:       <model type='virtio'/>
Oct 20 11:37:45 user nova-compute[74241]:       <mtu size='1442'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='net0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </interface>
Oct 20 11:37:45 user nova-compute[74241]:     <serial type='pty'>
Oct 20 11:37:45 user nova-compute[74241]:       <source path='/dev/pts/6'/>
Oct 20 11:37:45 user nova-compute[74241]:       <log file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log' append='off'/>
Oct 20 11:37:45 user nova-compute[74241]:       <target type='isa-serial' port='0'>
Oct 20 11:37:45 user nova-compute[74241]:         <model name='isa-serial'/>
Oct 20 11:37:45 user nova-compute[74241]:       </target>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='serial0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </serial>
Oct 20 11:37:45 user nova-compute[74241]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 11:37:45 user nova-compute[74241]:       <source path='/dev/pts/6'/>
Oct 20 11:37:45 user nova-compute[74241]:       <log file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log' append='off'/>
Oct 20 11:37:45 user nova-compute[74241]:       <target type='serial' port='0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='serial0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </console>
Oct 20 11:37:45 user nova-compute[74241]:     <input type='mouse' bus='ps2'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='input0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </input>
Oct 20 11:37:45 user nova-compute[74241]:     <input type='keyboard' bus='ps2'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='input1'/>
Oct 20 11:37:45 user nova-compute[74241]:     </input>
Oct 20 11:37:45 user nova-compute[74241]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 11:37:45 user nova-compute[74241]:       <listen type='address' address='0.0.0.0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </graphics>
Oct 20 11:37:45 user nova-compute[74241]:     <audio id='1' type='none'/>
Oct 20 11:37:45 user nova-compute[74241]:     <video>
Oct 20 11:37:45 user nova-compute[74241]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='video0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </video>
Oct 20 11:37:45 user nova-compute[74241]:     <memballoon model='virtio'>
Oct 20 11:37:45 user nova-compute[74241]:       <stats period='10'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='balloon0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </memballoon>
Oct 20 11:37:45 user nova-compute[74241]:     <rng model='virtio'>
Oct 20 11:37:45 user nova-compute[74241]:       <backend model='random'>/dev/urandom</backend>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='rng0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </rng>
Oct 20 11:37:45 user nova-compute[74241]:   </devices>
Oct 20 11:37:45 user nova-compute[74241]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 11:37:45 user nova-compute[74241]:     <label>libvirt-726a7f29-03b0-489f-a77d-9a77e5c4a546</label>
Oct 20 11:37:45 user nova-compute[74241]:     <imagelabel>libvirt-726a7f29-03b0-489f-a77d-9a77e5c4a546</imagelabel>
Oct 20 11:37:45 user nova-compute[74241]:   </seclabel>
Oct 20 11:37:45 user nova-compute[74241]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 11:37:45 user nova-compute[74241]:     <label>+64055:+108</label>
Oct 20 11:37:45 user nova-compute[74241]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 11:37:45 user nova-compute[74241]:   </seclabel>
Oct 20 11:37:45 user nova-compute[74241]: </domain>
Oct 20 11:37:45 user nova-compute[74241]:  {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface> {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fc:c5:d6"/><model type="virtio"/><mtu size="1442"/><target dev="tap2348d99b-d4"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 11:37:45 user nova-compute[74241]:   <name>instance-00000007</name>
Oct 20 11:37:45 user nova-compute[74241]:   <uuid>726a7f29-03b0-489f-a77d-9a77e5c4a546</uuid>
Oct 20 11:37:45 user nova-compute[74241]:   <metadata>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:45 user nova-compute[74241]:   <nova:package version="0.0.0"/>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:name>tempest-device-tagging-server-1761481514</nova:name>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:creationTime>2023-10-20 11:37:43</nova:creationTime>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:flavor name="m1.tiny">
Oct 20 11:37:45 user nova-compute[74241]:     <nova:memory>512</nova:memory>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:disk>1</nova:disk>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:swap>0</nova:swap>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:flavor>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:owner>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:user uuid="16555d6cef90422db4c851511083a34f">tempest-TaggedAttachmentsTest-20080626-project-member</nova:user>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:project uuid="ccb28511a3ff4f30bffdd7c8aa870c39">tempest-TaggedAttachmentsTest-20080626</nova:project>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:owner>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:ports>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:port uuid="88fde83f-c742-460e-8d1a-78982cbb685e">
Oct 20 11:37:45 user nova-compute[74241]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:37:45 user nova-compute[74241]:     </nova:port>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:ports>
Oct 20 11:37:45 user nova-compute[74241]: </nova:instance>
Oct 20 11:37:45 user nova-compute[74241]:   </metadata>
Oct 20 11:37:45 user nova-compute[74241]:   <memory unit='KiB'>524288</memory>
Oct 20 11:37:45 user nova-compute[74241]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 11:37:45 user nova-compute[74241]:   <vcpu placement='static'>1</vcpu>
Oct 20 11:37:45 user nova-compute[74241]:   <resource>
Oct 20 11:37:45 user nova-compute[74241]:     <partition>/machine</partition>
Oct 20 11:37:45 user nova-compute[74241]:   </resource>
Oct 20 11:37:45 user nova-compute[74241]:   <sysinfo type='smbios'>
Oct 20 11:37:45 user nova-compute[74241]:     <system>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='version'>0.0.0</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='serial'>726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='uuid'>726a7f29-03b0-489f-a77d-9a77e5c4a546</entry>
Oct 20 11:37:45 user nova-compute[74241]:       <entry name='family'>Virtual Machine</entry>
Oct 20 11:37:45 user nova-compute[74241]:     </system>
Oct 20 11:37:45 user nova-compute[74241]:   </sysinfo>
Oct 20 11:37:45 user nova-compute[74241]:   <os>
Oct 20 11:37:45 user nova-compute[74241]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 11:37:45 user nova-compute[74241]:     <boot dev='hd'/>
Oct 20 11:37:45 user nova-compute[74241]:     <smbios mode='sysinfo'/>
Oct 20 11:37:45 user nova-compute[74241]:   </os>
Oct 20 11:37:45 user nova-compute[74241]:   <features>
Oct 20 11:37:45 user nova-compute[74241]:     <acpi/>
Oct 20 11:37:45 user nova-compute[74241]:     <apic/>
Oct 20 11:37:45 user nova-compute[74241]:     <vmcoreinfo state='on'/>
Oct 20 11:37:45 user nova-compute[74241]:   </features>
Oct 20 11:37:45 user nova-compute[74241]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 11:37:45 user nova-compute[74241]:     <model fallback='forbid'>Nehalem</model>
Oct 20 11:37:45 user nova-compute[74241]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 11:37:45 user nova-compute[74241]:     <feature policy='require' name='vme'/>
Oct 20 11:37:45 user nova-compute[74241]:     <feature policy='require' name='x2apic'/>
Oct 20 11:37:45 user nova-compute[74241]:     <feature policy='require' name='hypervisor'/>
Oct 20 11:37:45 user nova-compute[74241]:   </cpu>
Oct 20 11:37:45 user nova-compute[74241]:   <clock offset='utc'>
Oct 20 11:37:45 user nova-compute[74241]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 11:37:45 user nova-compute[74241]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 11:37:45 user nova-compute[74241]:     <timer name='hpet' present='no'/>
Oct 20 11:37:45 user nova-compute[74241]:   </clock>
Oct 20 11:37:45 user nova-compute[74241]:   <on_poweroff>destroy</on_poweroff>
Oct 20 11:37:45 user nova-compute[74241]:   <on_reboot>restart</on_reboot>
Oct 20 11:37:45 user nova-compute[74241]:   <on_crash>destroy</on_crash>
Oct 20 11:37:45 user nova-compute[74241]:   <devices>
Oct 20 11:37:45 user nova-compute[74241]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 11:37:45 user nova-compute[74241]:     <disk type='file' device='disk'>
Oct 20 11:37:45 user nova-compute[74241]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 11:37:45 user nova-compute[74241]:       <source file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk' index='2'/>
Oct 20 11:37:45 user nova-compute[74241]:       <backingStore type='file' index='3'>
Oct 20 11:37:45 user nova-compute[74241]:         <format type='raw'/>
Oct 20 11:37:45 user nova-compute[74241]:         <source file='/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555'/>
Oct 20 11:37:45 user nova-compute[74241]:         <backingStore/>
Oct 20 11:37:45 user nova-compute[74241]:       </backingStore>
Oct 20 11:37:45 user nova-compute[74241]:       <target dev='vda' bus='virtio'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='virtio-disk0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </disk>
Oct 20 11:37:45 user nova-compute[74241]:     <disk type='file' device='cdrom'>
Oct 20 11:37:45 user nova-compute[74241]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 11:37:45 user nova-compute[74241]:       <source file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk.config' index='1'/>
Oct 20 11:37:45 user nova-compute[74241]:       <backingStore/>
Oct 20 11:37:45 user nova-compute[74241]:       <target dev='hda' bus='ide'/>
Oct 20 11:37:45 user nova-compute[74241]:       <readonly/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='ide0-0-0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </disk>
Oct 20 11:37:45 user nova-compute[74241]:     <controller type='usb' index='0' model='none'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='usb'/>
Oct 20 11:37:45 user nova-compute[74241]:     </controller>
Oct 20 11:37:45 user nova-compute[74241]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='pci.0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </controller>
Oct 20 11:37:45 user nova-compute[74241]:     <controller type='ide' index='0'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='ide'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 11:37:45 user nova-compute[74241]:     </controller>
Oct 20 11:37:45 user nova-compute[74241]:     <interface type='ethernet'>
Oct 20 11:37:45 user nova-compute[74241]:       <mac address='fa:16:3e:ae:a1:83'/>
Oct 20 11:37:45 user nova-compute[74241]:       <target dev='tap88fde83f-c7'/>
Oct 20 11:37:45 user nova-compute[74241]:       <model type='virtio'/>
Oct 20 11:37:45 user nova-compute[74241]:       <mtu size='1442'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='net0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </interface>
Oct 20 11:37:45 user nova-compute[74241]:     <serial type='pty'>
Oct 20 11:37:45 user nova-compute[74241]:       <source path='/dev/pts/6'/>
Oct 20 11:37:45 user nova-compute[74241]:       <log file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log' append='off'/>
Oct 20 11:37:45 user nova-compute[74241]:       <target type='isa-serial' port='0'>
Oct 20 11:37:45 user nova-compute[74241]:         <model name='isa-serial'/>
Oct 20 11:37:45 user nova-compute[74241]:       </target>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='serial0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </serial>
Oct 20 11:37:45 user nova-compute[74241]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 11:37:45 user nova-compute[74241]:       <source path='/dev/pts/6'/>
Oct 20 11:37:45 user nova-compute[74241]:       <log file='/opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/console.log' append='off'/>
Oct 20 11:37:45 user nova-compute[74241]:       <target type='serial' port='0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='serial0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </console>
Oct 20 11:37:45 user nova-compute[74241]:     <input type='mouse' bus='ps2'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='input0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </input>
Oct 20 11:37:45 user nova-compute[74241]:     <input type='keyboard' bus='ps2'>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='input1'/>
Oct 20 11:37:45 user nova-compute[74241]:     </input>
Oct 20 11:37:45 user nova-compute[74241]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 11:37:45 user nova-compute[74241]:       <listen type='address' address='0.0.0.0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </graphics>
Oct 20 11:37:45 user nova-compute[74241]:     <audio id='1' type='none'/>
Oct 20 11:37:45 user nova-compute[74241]:     <video>
Oct 20 11:37:45 user nova-compute[74241]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='video0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </video>
Oct 20 11:37:45 user nova-compute[74241]:     <memballoon model='virtio'>
Oct 20 11:37:45 user nova-compute[74241]:       <stats period='10'/>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='balloon0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </memballoon>
Oct 20 11:37:45 user nova-compute[74241]:     <rng model='virtio'>
Oct 20 11:37:45 user nova-compute[74241]:       <backend model='random'>/dev/urandom</backend>
Oct 20 11:37:45 user nova-compute[74241]:       <alias name='rng0'/>
Oct 20 11:37:45 user nova-compute[74241]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 11:37:45 user nova-compute[74241]:     </rng>
Oct 20 11:37:45 user nova-compute[74241]:   </devices>
Oct 20 11:37:45 user nova-compute[74241]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 11:37:45 user nova-compute[74241]:     <label>libvirt-726a7f29-03b0-489f-a77d-9a77e5c4a546</label>
Oct 20 11:37:45 user nova-compute[74241]:     <imagelabel>libvirt-726a7f29-03b0-489f-a77d-9a77e5c4a546</imagelabel>
Oct 20 11:37:45 user nova-compute[74241]:   </seclabel>
Oct 20 11:37:45 user nova-compute[74241]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 11:37:45 user nova-compute[74241]:     <label>+64055:+108</label>
Oct 20 11:37:45 user nova-compute[74241]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 11:37:45 user nova-compute[74241]:   </seclabel>
Oct 20 11:37:45 user nova-compute[74241]: </domain>
Oct 20 11:37:45 user nova-compute[74241]:  {{(pid=74241) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 11:37:45 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Detaching interface fa:16:3e:fc:c5:d6 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap2348d99b-d4' not found.
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Converting VIF {"id": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "address": "fa:16:3e:fc:c5:d6", "network": {"id": "7bcfeb73-8ad1-4a58-b261-09048f22fd30", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1496474473", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2348d99b-d4", "ovs_interfaceid": "2348d99b-d4b3-4938-ab06-ab5aa38e5116", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG os_vif [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2348d99b-d4, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:45 user nova-compute[74241]: INFO os_vif [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c5:d6,bridge_name='br-int',has_traffic_filtering=True,id=2348d99b-d4b3-4938-ab06-ab5aa38e5116,network=Network(7bcfeb73-8ad1-4a58-b261-09048f22fd30),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2348d99b-d4')
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [req-2a43930e-c1f7-4e3c-96e9-379a2927f11d req-e4d366e6-492f-4837-9001-ef0cf9a4befa service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:45 user nova-compute[74241]:   <nova:package version="0.0.0"/>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:name>tempest-device-tagging-server-1761481514</nova:name>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:creationTime>2023-10-20 11:37:45</nova:creationTime>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:flavor name="m1.tiny">
Oct 20 11:37:45 user nova-compute[74241]:     <nova:memory>512</nova:memory>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:disk>1</nova:disk>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:swap>0</nova:swap>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:flavor>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:owner>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:user uuid="16555d6cef90422db4c851511083a34f">tempest-TaggedAttachmentsTest-20080626-project-member</nova:user>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:project uuid="ccb28511a3ff4f30bffdd7c8aa870c39">tempest-TaggedAttachmentsTest-20080626</nova:project>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:owner>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:45 user nova-compute[74241]:   <nova:ports>
Oct 20 11:37:45 user nova-compute[74241]:     <nova:port uuid="88fde83f-c742-460e-8d1a-78982cbb685e">
Oct 20 11:37:45 user nova-compute[74241]:       <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:37:45 user nova-compute[74241]:     </nova:port>
Oct 20 11:37:45 user nova-compute[74241]:   </nova:ports>
Oct 20 11:37:45 user nova-compute[74241]: </nova:instance>
Oct 20 11:37:45 user nova-compute[74241]:  {{(pid=74241) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG nova.network.neutron [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating instance_info_cache with network_info: [{"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Releasing lock "refresh_cache-726a7f29-03b0-489f-a77d-9a77e5c4a546" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:37:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-062c3f95-e334-4117-9f55-645482b13e46 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "interface-726a7f29-03b0-489f-a77d-9a77e5c4a546-2348d99b-d4b3-4938-ab06-ab5aa38e5116" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.464s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:47 user nova-compute[74241]: WARNING nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Failed to detach volume: 33855670-3ed6-49b6-8476-289acdfd3483 due to 'NoneType' object has no attribute 'devices'
Oct 20 11:37:47 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Detaching volume: 87083b94-eaa5-487f-a82d-21b0fd7d40a8 {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 20 11:37:47 user nova-compute[74241]: INFO nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Detaching volume 87083b94-eaa5-487f-a82d-21b0fd7d40a8
Oct 20 11:37:47 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Skipping driver_detach during remote rebuild. {{(pid=74241) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 20 11:37:47 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:48 user nova-compute[74241]: WARNING nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Failed to detach volume: 87083b94-eaa5-487f-a82d-21b0fd7d40a8 due to 'NoneType' object has no attribute 'devices'
Oct 20 11:37:48 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Detaching volume: b95c7213-9164-4ee2-8f50-221f7be5d965 {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 20 11:37:48 user nova-compute[74241]: INFO nova.compute.manager [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Detaching volume b95c7213-9164-4ee2-8f50-221f7be5d965
Oct 20 11:37:48 user nova-compute[74241]: DEBUG nova.compute.manager [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'serial': 'c2ef804d-dc18-47c8-9809-8a29ea62bdbc'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akjTrJwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '5c6c6907-ef85-41f4-a42e-7e7792f2c612'}, 'status': 'reserved', 'instance': 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb', 'attached_at': '', 'detached_at': '', 'volume_id': '5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'serial'} {{(pid=74241) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:48 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:48 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:48 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] [instance: 3c73caa8-a299-41e1-bd85-66299f6641f1] Skipping driver_detach during remote rebuild. {{(pid=74241) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a823e8-c7d9-465d-8c4a-4fdc733174bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:37:48 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c6237b-d711-4468-89e6-c1c8f3491b84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc] added
Oct 20 11:37:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d019fe8d-4953-49c3-a09e-4562c3ade2b4]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccc665e-7e41-4b4c-8ef9-ca747a5a24bb]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGgbXIAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iGgbXIAP" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[db00db3d-b327-4bfa-a4f8-5e74779cc445]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iGgbXIAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[809dbad7-805b-4076-9cc1-ea39a0573ee3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb07ac2-985b-487e-b510-5c2ff490884a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:37:48 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Deleted allocations for instance 3c73caa8-a299-41e1-bd85-66299f6641f1
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9a2cc347-845b-45d7-98cb-74d13c143b76 tempest-TaggedBootDevicesTest-1193398918 tempest-TaggedBootDevicesTest-1193398918-project-member] Lock "3c73caa8-a299-41e1-bd85-66299f6641f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 173.721s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfae1ec1-8d27-4bac-b684-e31728e906f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260]
Oct 20 11:37:48 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260] successful.
Oct 20 11:37:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[748b8bc8-835e-4b10-9a97-5b37d6ec2b48]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a91cac-3453-44f4-bf65-4a42fb43c8de]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:48 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef52b15-6c62-4666-a9bb-c66c0476f26f]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23363313335313866', 'path': '/dev/sde'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363313335313866', 'path': '/dev/sde'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:37:49 user nova-compute[74241]: DEBUG nova.objects.instance [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lazy-loading 'flavor' on Instance uuid d77d035b-ec54-4c5e-8dd6-55e5297b02fb {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:37:50 user nova-compute[74241]: INFO nova.compute.claims [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Claim successful on node user
Oct 20 11:37:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 142606336 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.051s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 251658240 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:37:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.policy [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '555d42ae165f487a9fe068dd8b06e6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42b0bf8e61964896a236f83d739a7366', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:37:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Creating image(s)
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "/opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "/opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 385875968 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.204s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk 1073741824" returned: 0 in 0.105s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 464519168 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.229s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Successfully created port: fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-e600e7e3-46de-48ae-8f4c-f096effc55fb req-b6c7a520-23a4-49af-85e1-c47075308cf8 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event volume-reimaged-2238763d-1ef0-47ab-8b4d-426b0d0d935b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e600e7e3-46de-48ae-8f4c-f096effc55fb req-b6c7a520-23a4-49af-85e1-c47075308cf8 service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e600e7e3-46de-48ae-8f4c-f096effc55fb req-b6c7a520-23a4-49af-85e1-c47075308cf8 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e600e7e3-46de-48ae-8f4c-f096effc55fb req-b6c7a520-23a4-49af-85e1-c47075308cf8 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-e600e7e3-46de-48ae-8f4c-f096effc55fb req-b6c7a520-23a4-49af-85e1-c47075308cf8 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Processing event volume-reimaged-2238763d-1ef0-47ab-8b4d-426b0d0d935b {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json" returned: 0 in 0.813s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance event wait completed in 51 seconds for volume-reimaged {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 719323136 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Cannot resize image /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Ensure instance console log exists: /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:53 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:37:53 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7784MB free_disk=25.451236724853516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:53 user nova-compute[74241]: INFO nova.virt.block_device [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Booting with volume 2238763d-1ef0-47ab-8b4d-426b0d0d935b at /dev/vda
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 726a7f29-03b0-489f-a77d-9a77e5c4a546 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9f326446-5aa8-47f0-bc97-0f2c9664319f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 34e3ad13-abe7-4167-9d8c-474f59397b6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ed711b9c-3bfc-41c9-8a33-725ffa363a56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance c19279cb-daa2-491e-8288-e0f2ce35dc1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 2e3d3300-5e5c-4de7-8178-8342ad15a06b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 865075200 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG os_brick.utils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9456c491-3cce-4090-843f-47390f6306c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba8071d-d894-4881-a741-23a788d22891]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4137a70-ddee-48eb-a344-8d7ef6055eaf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9cf70-2a33-480b-9fa1-838d2d13c31b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:37:54 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6237360-a76f-4f6e-be66-bd041ad8dfbb]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG os_brick.utils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] <== get_connector_properties: return (187ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Updating existing volume attachment record: e6d8ee2a-3c95-4d7f-b057-b64d88b61d3d {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.819s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 1017118720 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Successfully updated port: fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "refresh_cache-2e3d3300-5e5c-4de7-8178-8342ad15a06b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquired lock "refresh_cache-2e3d3300-5e5c-4de7-8178-8342ad15a06b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-8021eddd-ab62-47ae-aec6-4fe6b670b2ad req-2829dab9-e54d-4682-8edf-0439b95b5ad9 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received event network-changed-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-8021eddd-ab62-47ae-aec6-4fe6b670b2ad req-2829dab9-e54d-4682-8edf-0439b95b5ad9 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Refreshing instance network info cache due to event network-changed-fd103f71-ffd8-45d8-a628-558f364e80b8. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8021eddd-ab62-47ae-aec6-4fe6b670b2ad req-2829dab9-e54d-4682-8edf-0439b95b5ad9 service nova] Acquiring lock "refresh_cache-2e3d3300-5e5c-4de7-8178-8342ad15a06b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akjTrJwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '5c6c6907-ef85-41f4-a42e-7e7792f2c612'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:37:55 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4223e6e7-5a83-4540-9122-d1f1446ac831]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:37:55 user nova-compute[74241]: No targets found.
Oct 20 11:37:55 user nova-compute[74241]: iSNS:
Oct 20 11:37:55 user nova-compute[74241]: No targets found.
Oct 20 11:37:55 user nova-compute[74241]: STATIC:
Oct 20 11:37:55 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:37:55 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:55 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:55 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:37:55 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:55 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:55 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:37:55 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:55 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:55 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612
Oct 20 11:37:55 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:55 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:55 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:37:55 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:55 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:55 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:37:55 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:37:55 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:37:55 user nova-compute[74241]: FIRMWARE:
Oct 20 11:37:55 user nova-compute[74241]: No targets found.
Oct 20 11:37:55 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:37:55 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:37:55 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b32976f-7ec3-4679-b0cf-22d79a251682]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ffac69-28d9-45d3-8fbb-be42a3ecb164]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:55 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:37:55 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:37:55 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52087d20e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c278d-6a29-4ecd-a30a-b18b7c57e74e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca8119-8392-4cb6-8fbe-45e1894f0435]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3969598-8ba4-40b4-b8a8-97711b531c96]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Updating instance_info_cache with network_info: [{"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Releasing lock "refresh_cache-2e3d3300-5e5c-4de7-8178-8342ad15a06b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Instance network_info: |[{"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8021eddd-ab62-47ae-aec6-4fe6b670b2ad req-2829dab9-e54d-4682-8edf-0439b95b5ad9 service nova] Acquired lock "refresh_cache-2e3d3300-5e5c-4de7-8178-8342ad15a06b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.network.neutron [req-8021eddd-ab62-47ae-aec6-4fe6b670b2ad req-2829dab9-e54d-4682-8edf-0439b95b5ad9 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Refreshing network info cache for port fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Start _get_guest_xml network_info=[{"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:37:55 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:37:55 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3053a838-dd5a-4155-a8c2-057d6414fa6a]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1251344815',display_name='tempest-VolumesAdminNegativeTest-server-1251344815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1251344815',id=13,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42b0bf8e61964896a236f83d739a7366',ramdisk_id='',reservation_id='r-pb0zy80l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-617790048',owner_user_name='tempest-VolumesAdminNegativeTest-617790048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:37:52Z,user_data=None,user_id='555d42ae165f487a9fe068dd8b06e6cc',uuid=2e3d3300-5e5c-4de7-8178-8342ad15a06b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converting VIF {"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fd:d5,bridge_name='br-int',has_traffic_filtering=True,id=fd103f71-ffd8-45d8-a628-558f364e80b8,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd103f71-ff') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.objects.instance [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e3d3300-5e5c-4de7-8178-8342ad15a06b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7c2c02-e8ab-4a8e-9f2e-c0255ba6d543]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:37:55 user nova-compute[74241]:   <uuid>2e3d3300-5e5c-4de7-8178-8342ad15a06b</uuid>
Oct 20 11:37:55 user nova-compute[74241]:   <name>instance-0000000d</name>
Oct 20 11:37:55 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:37:55 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:37:55 user nova-compute[74241]:   <metadata>
Oct 20 11:37:55 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:37:55 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:37:55 user nova-compute[74241]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1251344815</nova:name>
Oct 20 11:37:55 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:37:55</nova:creationTime>
Oct 20 11:37:55 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:37:55 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:37:55 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:37:55 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:37:55 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:37:55 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:37:55 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:37:55 user nova-compute[74241]:       <nova:owner>
Oct 20 11:37:55 user nova-compute[74241]:         <nova:user uuid="555d42ae165f487a9fe068dd8b06e6cc">tempest-VolumesAdminNegativeTest-617790048-project-member</nova:user>
Oct 20 11:37:55 user nova-compute[74241]:         <nova:project uuid="42b0bf8e61964896a236f83d739a7366">tempest-VolumesAdminNegativeTest-617790048</nova:project>
Oct 20 11:37:55 user nova-compute[74241]:       </nova:owner>
Oct 20 11:37:55 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:37:55 user nova-compute[74241]:       <nova:ports>
Oct 20 11:37:55 user nova-compute[74241]:         <nova:port uuid="fd103f71-ffd8-45d8-a628-558f364e80b8">
Oct 20 11:37:55 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 11:37:55 user nova-compute[74241]:         </nova:port>
Oct 20 11:37:55 user nova-compute[74241]:       </nova:ports>
Oct 20 11:37:55 user nova-compute[74241]:     </nova:instance>
Oct 20 11:37:55 user nova-compute[74241]:   </metadata>
Oct 20 11:37:55 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:37:55 user nova-compute[74241]:     <system>
Oct 20 11:37:55 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:37:55 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:37:55 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:37:55 user nova-compute[74241]:       <entry name="serial">2e3d3300-5e5c-4de7-8178-8342ad15a06b</entry>
Oct 20 11:37:55 user nova-compute[74241]:       <entry name="uuid">2e3d3300-5e5c-4de7-8178-8342ad15a06b</entry>
Oct 20 11:37:55 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:37:55 user nova-compute[74241]:     </system>
Oct 20 11:37:55 user nova-compute[74241]:   </sysinfo>
Oct 20 11:37:55 user nova-compute[74241]:   <os>
Oct 20 11:37:55 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:37:55 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:37:55 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:37:55 user nova-compute[74241]:   </os>
Oct 20 11:37:55 user nova-compute[74241]:   <features>
Oct 20 11:37:55 user nova-compute[74241]:     <acpi/>
Oct 20 11:37:55 user nova-compute[74241]:     <apic/>
Oct 20 11:37:55 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:37:55 user nova-compute[74241]:   </features>
Oct 20 11:37:55 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:37:55 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:37:55 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:37:55 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:37:55 user nova-compute[74241]:   </clock>
Oct 20 11:37:55 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:37:55 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:37:55 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:37:55 user nova-compute[74241]:   </cpu>
Oct 20 11:37:55 user nova-compute[74241]:   <devices>
Oct 20 11:37:55 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:37:55 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:37:55 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk"/>
Oct 20 11:37:55 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:37:55 user nova-compute[74241]:     </disk>
Oct 20 11:37:55 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:37:55 user nova-compute[74241]:       <mac address="fa:16:3e:e3:fd:d5"/>
Oct 20 11:37:55 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:37:55 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:37:55 user nova-compute[74241]:       <target dev="tapfd103f71-ff"/>
Oct 20 11:37:55 user nova-compute[74241]:     </interface>
Oct 20 11:37:55 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:37:55 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/console.log" append="off"/>
Oct 20 11:37:55 user nova-compute[74241]:     </serial>
Oct 20 11:37:55 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:37:55 user nova-compute[74241]:     <video>
Oct 20 11:37:55 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:37:55 user nova-compute[74241]:     </video>
Oct 20 11:37:55 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:37:55 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:37:55 user nova-compute[74241]:     </rng>
Oct 20 11:37:55 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:37:55 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:37:55 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:37:55 user nova-compute[74241]:     </memballoon>
Oct 20 11:37:55 user nova-compute[74241]:   </devices>
Oct 20 11:37:55 user nova-compute[74241]: </domain>
Oct 20 11:37:55 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1251344815',display_name='tempest-VolumesAdminNegativeTest-server-1251344815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1251344815',id=13,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42b0bf8e61964896a236f83d739a7366',ramdisk_id='',reservation_id='r-pb0zy80l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-617790048',owner_user_name='tempest-VolumesAdminNegativeTest-617790048-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:37:52Z,user_data=None,user_id='555d42ae165f487a9fe068dd8b06e6cc',uuid=2e3d3300-5e5c-4de7-8178-8342ad15a06b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converting VIF {"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fd:d5,bridge_name='br-int',has_traffic_filtering=True,id=fd103f71-ffd8-45d8-a628-558f364e80b8,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd103f71-ff') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_vif [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fd:d5,bridge_name='br-int',has_traffic_filtering=True,id=fd103f71-ffd8-45d8-a628-558f364e80b8,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd103f71-ff') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14fcdc16-0119-5b5d-b5e3-2d5ef93dd5e5', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd103f71-ff, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd103f71-ff, col_values=(('qos', UUID('75a3f3fa-1a80-4d0d-9bdf-0988dd7de279')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd103f71-ff, col_values=(('external_ids', {'iface-id': 'fd103f71-ffd8-45d8-a628-558f364e80b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:fd:d5', 'vm-uuid': '2e3d3300-5e5c-4de7-8178-8342ad15a06b'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:55 user nova-compute[74241]: INFO os_vif [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fd:d5,bridge_name='br-int',has_traffic_filtering=True,id=fd103f71-ffd8-45d8-a628-558f364e80b8,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd103f71-ff')
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea5ddbf-ddde-4053-8e80-dc7e49f397b2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612, portal: 172.16.0.220,3260]
Oct 20 11:37:55 user nova-compute[74241]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612, portal: 172.16.0.220,3260] successful.
Oct 20 11:37:55 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] No VIF found with MAC fa:16:3e:e3:fd:d5, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6c6907-ef85-41f4-a42e-7e7792f2c612 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdcaeb2-0267-4c8c-8032-94af0ff11ae0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.485s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] <== disconnect_volume: return (487ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'serial'} {{(pid=74241) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 11:37:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] swap_volume: removing Cinder connection for volume 5c6c6907-ef85-41f4-a42e-7e7792f2c612 {{(pid=74241) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG nova.network.neutron [req-8021eddd-ab62-47ae-aec6-4fe6b670b2ad req-2829dab9-e54d-4682-8edf-0439b95b5ad9 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Updated VIF entry in instance network info cache for port fd103f71-ffd8-45d8-a628-558f364e80b8. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG nova.network.neutron [req-8021eddd-ab62-47ae-aec6-4fe6b670b2ad req-2829dab9-e54d-4682-8edf-0439b95b5ad9 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Updating instance_info_cache with network_info: [{"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8021eddd-ab62-47ae-aec6-4fe6b670b2ad req-2829dab9-e54d-4682-8edf-0439b95b5ad9 service nova] Releasing lock "refresh_cache-2e3d3300-5e5c-4de7-8178-8342ad15a06b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updating instance_info_cache with network_info: [{"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-d77d035b-ec54-4c5e-8dd6-55e5297b02fb" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] swap_volume: Updating volume 5c6c6907-ef85-41f4-a42e-7e7792f2c612 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "iGgbXIAP", "auth_password": "lG0tbu2zFgnriH", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "c2ef804d-dc18-47c8-9809-8a29ea62bdbc"}, "status": "reserved", "instance": "d77d035b-ec54-4c5e-8dd6-55e5297b02fb", "attached_at": "", "detached_at": "", "volume_id": "c2ef804d-dc18-47c8-9809-8a29ea62bdbc", "serial": "c2ef804d-dc18-47c8-9809-8a29ea62bdbc"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'no_device': None, 'attachment_id': '3bf713f9-74d5-49ca-8e5f-6a5f64d5f413'} {{(pid=74241) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-749c2363-ea00-486a-8314-efc58b4cf63b tempest-TestVolumeSwap-100261293 tempest-TestVolumeSwap-100261293-project-admin] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 31.737s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-e7cfc139-db19-4986-804c-58d8f1203109 req-c9f27b76-179f-4a2a-975c-40d0d5b75b97 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received event network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e7cfc139-db19-4986-804c-58d8f1203109 req-c9f27b76-179f-4a2a-975c-40d0d5b75b97 service nova] Acquiring lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e7cfc139-db19-4986-804c-58d8f1203109 req-c9f27b76-179f-4a2a-975c-40d0d5b75b97 service nova] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e7cfc139-db19-4986-804c-58d8f1203109 req-c9f27b76-179f-4a2a-975c-40d0d5b75b97 service nova] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-e7cfc139-db19-4986-804c-58d8f1203109 req-c9f27b76-179f-4a2a-975c-40d0d5b75b97 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] No waiting events found dispatching network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:57 user nova-compute[74241]: WARNING nova.compute.manager [req-e7cfc139-db19-4986-804c-58d8f1203109 req-c9f27b76-179f-4a2a-975c-40d0d5b75b97 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received unexpected event network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 for instance with vm_state building and task_state spawning.
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:37:57 user nova-compute[74241]: INFO nova.compute.claims [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Claim successful on node user
Oct 20 11:37:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:57 user nova-compute[74241]: INFO nova.compute.manager [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Detaching volume c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:37:57 user nova-compute[74241]: INFO nova.virt.block_device [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Attempting to driver detach volume c2ef804d-dc18-47c8-9809-8a29ea62bdbc from mountpoint /dev/vdb
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Attempting to detach device vdb from instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:37:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:37:57 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:37:57 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:37:57 user nova-compute[74241]:   <serial>c2ef804d-dc18-47c8-9809-8a29ea62bdbc</serial>
Oct 20 11:37:57 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:37:57 user nova-compute[74241]: </disk>
Oct 20 11:37:57 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:37:57 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Successfully detached device vdb from instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb from the persistent domain config.
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:37:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:37:57 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:37:57 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:37:57 user nova-compute[74241]:   <serial>c2ef804d-dc18-47c8-9809-8a29ea62bdbc</serial>
Oct 20 11:37:57 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:37:57 user nova-compute[74241]: </disk>
Oct 20 11:37:57 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:37:57 user nova-compute[74241]: DEBUG nova.network.neutron [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:37:57 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.policy [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3637bc89e77c475ba2fc72002d61b5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce95d8752f04f25a15f0673b063d405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:37:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Creating image(s)
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "/opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "/opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "/opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk 1073741824" returned: 0 in 0.050s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Successfully created port: 4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Cannot resize image /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Ensure instance console log exists: /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-b814d72e-b268-4938-a2b8-2a97c39125ca req-c4d9386a-7403-4c77-8174-a4aab2e04cda service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received event network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b814d72e-b268-4938-a2b8-2a97c39125ca req-c4d9386a-7403-4c77-8174-a4aab2e04cda service nova] Acquiring lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b814d72e-b268-4938-a2b8-2a97c39125ca req-c4d9386a-7403-4c77-8174-a4aab2e04cda service nova] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b814d72e-b268-4938-a2b8-2a97c39125ca req-c4d9386a-7403-4c77-8174-a4aab2e04cda service nova] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-b814d72e-b268-4938-a2b8-2a97c39125ca req-c4d9386a-7403-4c77-8174-a4aab2e04cda service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] No waiting events found dispatching network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:37:59 user nova-compute[74241]: WARNING nova.compute.manager [req-b814d72e-b268-4938-a2b8-2a97c39125ca req-c4d9386a-7403-4c77-8174-a4aab2e04cda service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received unexpected event network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 for instance with vm_state building and task_state spawning.
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:37:59 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Instance spawned successfully.
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Successfully updated port: 4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquired lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:37:59 user nova-compute[74241]: INFO nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Took 7.65 seconds to spawn the instance on the hypervisor.
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-9eb6fdc0-6918-4725-921f-f8aaf700a11a req-673921ec-0a74-4035-b099-506105972d3c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-changed-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-9eb6fdc0-6918-4725-921f-f8aaf700a11a req-673921ec-0a74-4035-b099-506105972d3c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Refreshing instance network info cache due to event network-changed-4e6456d2-605c-4ddb-a205-06de64ae7c77. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9eb6fdc0-6918-4725-921f-f8aaf700a11a req-673921ec-0a74-4035-b099-506105972d3c service nova] Acquiring lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:37:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:37:59 user nova-compute[74241]: INFO nova.compute.manager [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Took 9.36 seconds to build instance.
Oct 20 11:37:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84e88ec7-a486-4459-a140-7232c1dc7b28 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.511s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updating instance_info_cache with network_info: [{"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Releasing lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Instance network_info: |[{"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9eb6fdc0-6918-4725-921f-f8aaf700a11a req-673921ec-0a74-4035-b099-506105972d3c service nova] Acquired lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-9eb6fdc0-6918-4725-921f-f8aaf700a11a req-673921ec-0a74-4035-b099-506105972d3c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Refreshing network info cache for port 4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Start _get_guest_xml network_info=[{"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:38:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:38:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1743344228',display_name='tempest-AttachVolumeNegativeTest-server-1743344228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1743344228',id=14,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHixfmrxpuw7SOqTCQhnXyOFgdC9VGSeavnBkOp24o5mz+VfG33RJJqiMijZL4dMlcGy1Y3ZApnH34YUHDQSONKgogkXqQfx3WljL/aoDBD26xRk+JrF/DHIMr9GeYj1ug==',key_name='tempest-keypair-1782338047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-ujbjq7l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=217655bc-d22a-4c39-9522-29f189a6bb5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ad:64,bridge_name='br-int',has_traffic_filtering=True,id=4e6456d2-605c-4ddb-a205-06de64ae7c77,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6456d2-60') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.objects.instance [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'pci_devices' on Instance uuid 217655bc-d22a-4c39-9522-29f189a6bb5f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:38:00 user nova-compute[74241]:   <uuid>217655bc-d22a-4c39-9522-29f189a6bb5f</uuid>
Oct 20 11:38:00 user nova-compute[74241]:   <name>instance-0000000e</name>
Oct 20 11:38:00 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:38:00 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:38:00 user nova-compute[74241]:   <metadata>
Oct 20 11:38:00 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:38:00 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:38:00 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1743344228</nova:name>
Oct 20 11:38:00 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:38:00</nova:creationTime>
Oct 20 11:38:00 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:38:00 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:38:00 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:38:00 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:38:00 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:38:00 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:38:00 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:38:00 user nova-compute[74241]:       <nova:owner>
Oct 20 11:38:00 user nova-compute[74241]:         <nova:user uuid="3637bc89e77c475ba2fc72002d61b5c2">tempest-AttachVolumeNegativeTest-252317716-project-member</nova:user>
Oct 20 11:38:00 user nova-compute[74241]:         <nova:project uuid="4ce95d8752f04f25a15f0673b063d405">tempest-AttachVolumeNegativeTest-252317716</nova:project>
Oct 20 11:38:00 user nova-compute[74241]:       </nova:owner>
Oct 20 11:38:00 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:38:00 user nova-compute[74241]:       <nova:ports>
Oct 20 11:38:00 user nova-compute[74241]:         <nova:port uuid="4e6456d2-605c-4ddb-a205-06de64ae7c77">
Oct 20 11:38:00 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 11:38:00 user nova-compute[74241]:         </nova:port>
Oct 20 11:38:00 user nova-compute[74241]:       </nova:ports>
Oct 20 11:38:00 user nova-compute[74241]:     </nova:instance>
Oct 20 11:38:00 user nova-compute[74241]:   </metadata>
Oct 20 11:38:00 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:38:00 user nova-compute[74241]:     <system>
Oct 20 11:38:00 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:38:00 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:38:00 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:38:00 user nova-compute[74241]:       <entry name="serial">217655bc-d22a-4c39-9522-29f189a6bb5f</entry>
Oct 20 11:38:00 user nova-compute[74241]:       <entry name="uuid">217655bc-d22a-4c39-9522-29f189a6bb5f</entry>
Oct 20 11:38:00 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:38:00 user nova-compute[74241]:     </system>
Oct 20 11:38:00 user nova-compute[74241]:   </sysinfo>
Oct 20 11:38:00 user nova-compute[74241]:   <os>
Oct 20 11:38:00 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:38:00 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:38:00 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:38:00 user nova-compute[74241]:   </os>
Oct 20 11:38:00 user nova-compute[74241]:   <features>
Oct 20 11:38:00 user nova-compute[74241]:     <acpi/>
Oct 20 11:38:00 user nova-compute[74241]:     <apic/>
Oct 20 11:38:00 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:38:00 user nova-compute[74241]:   </features>
Oct 20 11:38:00 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:38:00 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:38:00 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:38:00 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:38:00 user nova-compute[74241]:   </clock>
Oct 20 11:38:00 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:38:00 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:38:00 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:38:00 user nova-compute[74241]:   </cpu>
Oct 20 11:38:00 user nova-compute[74241]:   <devices>
Oct 20 11:38:00 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:38:00 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:38:00 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk"/>
Oct 20 11:38:00 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:38:00 user nova-compute[74241]:     </disk>
Oct 20 11:38:00 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:38:00 user nova-compute[74241]:       <mac address="fa:16:3e:f4:ad:64"/>
Oct 20 11:38:00 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:38:00 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:38:00 user nova-compute[74241]:       <target dev="tap4e6456d2-60"/>
Oct 20 11:38:00 user nova-compute[74241]:     </interface>
Oct 20 11:38:00 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:38:00 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/console.log" append="off"/>
Oct 20 11:38:00 user nova-compute[74241]:     </serial>
Oct 20 11:38:00 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:38:00 user nova-compute[74241]:     <video>
Oct 20 11:38:00 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:38:00 user nova-compute[74241]:     </video>
Oct 20 11:38:00 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:38:00 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:38:00 user nova-compute[74241]:     </rng>
Oct 20 11:38:00 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:38:00 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:38:00 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:38:00 user nova-compute[74241]:     </memballoon>
Oct 20 11:38:00 user nova-compute[74241]:   </devices>
Oct 20 11:38:00 user nova-compute[74241]: </domain>
Oct 20 11:38:00 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1743344228',display_name='tempest-AttachVolumeNegativeTest-server-1743344228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1743344228',id=14,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHixfmrxpuw7SOqTCQhnXyOFgdC9VGSeavnBkOp24o5mz+VfG33RJJqiMijZL4dMlcGy1Y3ZApnH34YUHDQSONKgogkXqQfx3WljL/aoDBD26xRk+JrF/DHIMr9GeYj1ug==',key_name='tempest-keypair-1782338047',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-ujbjq7l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:37:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=217655bc-d22a-4c39-9522-29f189a6bb5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ad:64,bridge_name='br-int',has_traffic_filtering=True,id=4e6456d2-605c-4ddb-a205-06de64ae7c77,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6456d2-60') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG os_vif [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ad:64,bridge_name='br-int',has_traffic_filtering=True,id=4e6456d2-605c-4ddb-a205-06de64ae7c77,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6456d2-60') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd244be65-8a4c-54fb-a36c-03a278e42534', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e6456d2-60, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e6456d2-60, col_values=(('qos', UUID('0baf191e-714a-4af0-85bd-2e1f90e5d532')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e6456d2-60, col_values=(('external_ids', {'iface-id': '4e6456d2-605c-4ddb-a205-06de64ae7c77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:ad:64', 'vm-uuid': '217655bc-d22a-4c39-9522-29f189a6bb5f'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:00 user nova-compute[74241]: INFO os_vif [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:ad:64,bridge_name='br-int',has_traffic_filtering=True,id=4e6456d2-605c-4ddb-a205-06de64ae7c77,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6456d2-60')
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No VIF found with MAC fa:16:3e:f4:ad:64, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-9eb6fdc0-6918-4725-921f-f8aaf700a11a req-673921ec-0a74-4035-b099-506105972d3c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updated VIF entry in instance network info cache for port 4e6456d2-605c-4ddb-a205-06de64ae7c77. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-9eb6fdc0-6918-4725-921f-f8aaf700a11a req-673921ec-0a74-4035-b099-506105972d3c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updating instance_info_cache with network_info: [{"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9eb6fdc0-6918-4725-921f-f8aaf700a11a req-673921ec-0a74-4035-b099-506105972d3c service nova] Releasing lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:38:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-9e57d604-29ab-483a-878d-9b3eacf54653 req-c54cee92-22ac-48fe-9a97-1e4e2f78a678 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9e57d604-29ab-483a-878d-9b3eacf54653 req-c54cee92-22ac-48fe-9a97-1e4e2f78a678 service nova] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9e57d604-29ab-483a-878d-9b3eacf54653 req-c54cee92-22ac-48fe-9a97-1e4e2f78a678 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9e57d604-29ab-483a-878d-9b3eacf54653 req-c54cee92-22ac-48fe-9a97-1e4e2f78a678 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-9e57d604-29ab-483a-878d-9b3eacf54653 req-c54cee92-22ac-48fe-9a97-1e4e2f78a678 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] No waiting events found dispatching network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:02 user nova-compute[74241]: WARNING nova.compute.manager [req-9e57d604-29ab-483a-878d-9b3eacf54653 req-c54cee92-22ac-48fe-9a97-1e4e2f78a678 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received unexpected event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 for instance with vm_state building and task_state spawning.
Oct 20 11:38:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-700cd447-e393-48fa-a8bd-739f415dcef7 req-d46b2cb5-9bef-4342-aa49-707ae82ee6db service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-700cd447-e393-48fa-a8bd-739f415dcef7 req-d46b2cb5-9bef-4342-aa49-707ae82ee6db service nova] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-700cd447-e393-48fa-a8bd-739f415dcef7 req-d46b2cb5-9bef-4342-aa49-707ae82ee6db service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-700cd447-e393-48fa-a8bd-739f415dcef7 req-d46b2cb5-9bef-4342-aa49-707ae82ee6db service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-700cd447-e393-48fa-a8bd-739f415dcef7 req-d46b2cb5-9bef-4342-aa49-707ae82ee6db service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] No waiting events found dispatching network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:04 user nova-compute[74241]: WARNING nova.compute.manager [req-700cd447-e393-48fa-a8bd-739f415dcef7 req-d46b2cb5-9bef-4342-aa49-707ae82ee6db service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received unexpected event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 for instance with vm_state building and task_state spawning.
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:38:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Instance spawned successfully.
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:04 user nova-compute[74241]: INFO nova.compute.manager [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Terminating instance
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:38:04 user nova-compute[74241]: INFO nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Took 6.37 seconds to spawn the instance on the hypervisor.
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:04 user nova-compute[74241]: INFO nova.compute.manager [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Took 7.44 seconds to build instance.
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-95d1d7f6-aa74-4a51-babb-029307879bfa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.565s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-042ad53b-de74-4421-8ceb-772285bc6630 req-19999792-37e9-4470-a2ef-1210d6d2bd6b service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received event network-vif-unplugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-042ad53b-de74-4421-8ceb-772285bc6630 req-19999792-37e9-4470-a2ef-1210d6d2bd6b service nova] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-042ad53b-de74-4421-8ceb-772285bc6630 req-19999792-37e9-4470-a2ef-1210d6d2bd6b service nova] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-042ad53b-de74-4421-8ceb-772285bc6630 req-19999792-37e9-4470-a2ef-1210d6d2bd6b service nova] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-042ad53b-de74-4421-8ceb-772285bc6630 req-19999792-37e9-4470-a2ef-1210d6d2bd6b service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] No waiting events found dispatching network-vif-unplugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-042ad53b-de74-4421-8ceb-772285bc6630 req-19999792-37e9-4470-a2ef-1210d6d2bd6b service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received event network-vif-unplugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Instance destroyed successfully.
Oct 20 11:38:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lazy-loading 'resources' on Instance uuid 9f326446-5aa8-47f0-bc97-0f2c9664319f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-45059038',display_name='tempest-VolumesAssistedSnapshotsTest-server-45059038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-45059038',id=8,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvwM7RaGshWqAOA17uile1AkXJS8LxWk0Cp0pqxGclZarMCb1acQ6heVUuirVD2y3MHeBxj4a8zHrIG6xN7IkKmaO4w+P//yVJ3DozZynuAlQgFiLqBZI5mjNc+h8TkVg==',key_name='tempest-keypair-1647619543',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2389f277868946dc9f4f5f4d82057534',ramdisk_id='',reservation_id='r-chvlof1i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2031640903',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2031640903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ceec2bec1614ffb8faa22b5fa31a300',uuid=9f326446-5aa8-47f0-bc97-0f2c9664319f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Converting VIF {"id": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "address": "fa:16:3e:9a:41:14", "network": {"id": "904df803-d42a-44a6-9e39-df778151fbd5", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-2106503861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2389f277868946dc9f4f5f4d82057534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2248f184-5e", "ovs_interfaceid": "2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:41:14,bridge_name='br-int',has_traffic_filtering=True,id=2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3,network=Network(904df803-d42a-44a6-9e39-df778151fbd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2248f184-5e') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG os_vif [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:41:14,bridge_name='br-int',has_traffic_filtering=True,id=2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3,network=Network(904df803-d42a-44a6-9e39-df778151fbd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2248f184-5e') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2248f184-5e, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=687473e4-c6e2-440f-aa06-4a0a32ecaf44) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:05 user nova-compute[74241]: INFO os_vif [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:41:14,bridge_name='br-int',has_traffic_filtering=True,id=2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3,network=Network(904df803-d42a-44a6-9e39-df778151fbd5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2248f184-5e')
Oct 20 11:38:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Deleting instance files /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f_del
Oct 20 11:38:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Deletion of /opt/stack/data/nova/instances/9f326446-5aa8-47f0-bc97-0f2c9664319f_del complete
Oct 20 11:38:05 user nova-compute[74241]: INFO nova.compute.manager [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 20 11:38:05 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:38:05 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:38:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:06 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:06 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Took 1.36 seconds to deallocate network for instance.
Oct 20 11:38:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-94a434a9-4667-4a5d-bb00-63eaf7728734 req-f71a64a9-e214-47c6-a99d-4987c4997b49 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received event network-vif-deleted-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:06 user nova-compute[74241]: INFO nova.compute.manager [req-94a434a9-4667-4a5d-bb00-63eaf7728734 req-f71a64a9-e214-47c6-a99d-4987c4997b49 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Neutron deleted interface 2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3; detaching it from the instance and deleting it from the info cache
Oct 20 11:38:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-94a434a9-4667-4a5d-bb00-63eaf7728734 req-f71a64a9-e214-47c6-a99d-4987c4997b49 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-94a434a9-4667-4a5d-bb00-63eaf7728734 req-f71a64a9-e214-47c6-a99d-4987c4997b49 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Detach interface failed, port_id=2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3, reason: Instance 9f326446-5aa8-47f0-bc97-0f2c9664319f could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:38:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-2d2fe00e-66e3-4c49-89f4-bd92816eb926 req-04d8eb9a-581c-4dd5-a559-add4628cb449 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received event network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2d2fe00e-66e3-4c49-89f4-bd92816eb926 req-04d8eb9a-581c-4dd5-a559-add4628cb449 service nova] Acquiring lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2d2fe00e-66e3-4c49-89f4-bd92816eb926 req-04d8eb9a-581c-4dd5-a559-add4628cb449 service nova] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2d2fe00e-66e3-4c49-89f4-bd92816eb926 req-04d8eb9a-581c-4dd5-a559-add4628cb449 service nova] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-2d2fe00e-66e3-4c49-89f4-bd92816eb926 req-04d8eb9a-581c-4dd5-a559-add4628cb449 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] No waiting events found dispatching network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:07 user nova-compute[74241]: WARNING nova.compute.manager [req-2d2fe00e-66e3-4c49-89f4-bd92816eb926 req-04d8eb9a-581c-4dd5-a559-add4628cb449 service nova] [instance: 9f326446-5aa8-47f0-bc97-0f2c9664319f] Received unexpected event network-vif-plugged-2248f184-5e0d-4bd7-ac0d-bd2f4d0b85e3 for instance with vm_state deleted and task_state None.
Oct 20 11:38:07 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:38:07 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:38:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:07 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Deleted allocations for instance 9f326446-5aa8-47f0-bc97-0f2c9664319f
Oct 20 11:38:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b4df7cc-bfc3-4a15-9aa2-9268021ec68b tempest-VolumesAssistedSnapshotsTest-2031640903 tempest-VolumesAssistedSnapshotsTest-2031640903-project-member] Lock "9f326446-5aa8-47f0-bc97-0f2c9664319f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.017s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-64c794fb-7339-445f-b6b9-b7adc26b7443 req-c8ecb322-6f3c-46f3-9cc3-c7e7506cdedb service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-changed-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-64c794fb-7339-445f-b6b9-b7adc26b7443 req-c8ecb322-6f3c-46f3-9cc3-c7e7506cdedb service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing instance network info cache due to event network-changed-3a371ba7-fd54-4cad-8a82-230fcddc7baf. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:38:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-64c794fb-7339-445f-b6b9-b7adc26b7443 req-c8ecb322-6f3c-46f3-9cc3-c7e7506cdedb service nova] Acquiring lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:38:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-64c794fb-7339-445f-b6b9-b7adc26b7443 req-c8ecb322-6f3c-46f3-9cc3-c7e7506cdedb service nova] Acquired lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:38:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-64c794fb-7339-445f-b6b9-b7adc26b7443 req-c8ecb322-6f3c-46f3-9cc3-c7e7506cdedb service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Refreshing network info cache for port 3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:38:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-64c794fb-7339-445f-b6b9-b7adc26b7443 req-c8ecb322-6f3c-46f3-9cc3-c7e7506cdedb service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updated VIF entry in instance network info cache for port 3a371ba7-fd54-4cad-8a82-230fcddc7baf. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:38:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-64c794fb-7339-445f-b6b9-b7adc26b7443 req-c8ecb322-6f3c-46f3-9cc3-c7e7506cdedb service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [{"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-64c794fb-7339-445f-b6b9-b7adc26b7443 req-c8ecb322-6f3c-46f3-9cc3-c7e7506cdedb service nova] Releasing lock "refresh_cache-ed711b9c-3bfc-41c9-8a33-725ffa363a56" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:10 user nova-compute[74241]: INFO nova.compute.manager [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Terminating instance
Oct 20 11:38:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-b7193a72-f21d-447b-836f-867eea1314a5 req-cd08a909-8793-4569-acdf-0974280b6d6e service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7193a72-f21d-447b-836f-867eea1314a5 req-cd08a909-8793-4569-acdf-0974280b6d6e service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7193a72-f21d-447b-836f-867eea1314a5 req-cd08a909-8793-4569-acdf-0974280b6d6e service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7193a72-f21d-447b-836f-867eea1314a5 req-cd08a909-8793-4569-acdf-0974280b6d6e service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-b7193a72-f21d-447b-836f-867eea1314a5 req-cd08a909-8793-4569-acdf-0974280b6d6e service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-unplugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-b7193a72-f21d-447b-836f-867eea1314a5 req-cd08a909-8793-4569-acdf-0974280b6d6e service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-unplugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:11 user nova-compute[74241]: WARNING nova.compute.manager [req-a06b00e5-21ba-45f4-b15a-6a5aecca6279 req-37b295f2-1b03-4555-81e8-99eea3ff1f73 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-3a371ba7-fd54-4cad-8a82-230fcddc7baf for instance with vm_state active and task_state deleting.
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-c398a861-0ba5-400d-bbdc-e1b84de32fa4 req-d5bd6097-54d9-4f79-81c3-20ed8b0540d9 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c398a861-0ba5-400d-bbdc-e1b84de32fa4 req-d5bd6097-54d9-4f79-81c3-20ed8b0540d9 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c398a861-0ba5-400d-bbdc-e1b84de32fa4 req-d5bd6097-54d9-4f79-81c3-20ed8b0540d9 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c398a861-0ba5-400d-bbdc-e1b84de32fa4 req-d5bd6097-54d9-4f79-81c3-20ed8b0540d9 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-c398a861-0ba5-400d-bbdc-e1b84de32fa4 req-d5bd6097-54d9-4f79-81c3-20ed8b0540d9 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-unplugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-c398a861-0ba5-400d-bbdc-e1b84de32fa4 req-d5bd6097-54d9-4f79-81c3-20ed8b0540d9 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Instance destroyed successfully.
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lazy-loading 'resources' on Instance uuid ed711b9c-3bfc-41c9-8a33-725ffa363a56 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:36:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:34:ff,bridge_name='br-int',has_traffic_filtering=True,id=3a371ba7-fd54-4cad-8a82-230fcddc7baf,network=Network(6289f056-40bc-4716-b888-f158fb387476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a371ba7-fd') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:34:ff,bridge_name='br-int',has_traffic_filtering=True,id=3a371ba7-fd54-4cad-8a82-230fcddc7baf,network=Network(6289f056-40bc-4716-b888-f158fb387476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a371ba7-fd') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a371ba7-fd, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3acfbba7-efef-48bb-b06e-62ae24b7fb07) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: INFO os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:34:ff,bridge_name='br-int',has_traffic_filtering=True,id=3a371ba7-fd54-4cad-8a82-230fcddc7baf,network=Network(6289f056-40bc-4716-b888-f158fb387476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a371ba7-fd')
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:36:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f3bb6d7-0b') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f3bb6d7-0b') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f3bb6d7-0b, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97f7d6f8-b84f-45a1-8807-fe72beb5568d) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: INFO os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:74:a5,bridge_name='br-int',has_traffic_filtering=True,id=2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2f3bb6d7-0b')
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:36:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:2f,bridge_name='br-int',has_traffic_filtering=True,id=53e1bac0-1951-49d1-9086-7c35a689302a,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53e1bac0-19') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:2f,bridge_name='br-int',has_traffic_filtering=True,id=53e1bac0-1951-49d1-9086-7c35a689302a,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53e1bac0-19') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53e1bac0-19, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfee8699-d4e0-4f0c-a489-b7e890dd1eaa) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-1dd29089-0009-48e2-a62d-ad55669a9a5f req-6219a9ea-f63d-4cad-9cd6-e1e3617a34fd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1dd29089-0009-48e2-a62d-ad55669a9a5f req-6219a9ea-f63d-4cad-9cd6-e1e3617a34fd service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1dd29089-0009-48e2-a62d-ad55669a9a5f req-6219a9ea-f63d-4cad-9cd6-e1e3617a34fd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1dd29089-0009-48e2-a62d-ad55669a9a5f req-6219a9ea-f63d-4cad-9cd6-e1e3617a34fd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-1dd29089-0009-48e2-a62d-ad55669a9a5f req-6219a9ea-f63d-4cad-9cd6-e1e3617a34fd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:12 user nova-compute[74241]: WARNING nova.compute.manager [req-1dd29089-0009-48e2-a62d-ad55669a9a5f req-6219a9ea-f63d-4cad-9cd6-e1e3617a34fd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec for instance with vm_state active and task_state deleting.
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: INFO os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:07:2f,bridge_name='br-int',has_traffic_filtering=True,id=53e1bac0-1951-49d1-9086-7c35a689302a,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap53e1bac0-19')
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:36:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:70,bridge_name='br-int',has_traffic_filtering=True,id=1c415635-1c86-40b7-b0fb-9e2d3a59f99c,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c415635-1c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:70,bridge_name='br-int',has_traffic_filtering=True,id=1c415635-1c86-40b7-b0fb-9e2d3a59f99c,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c415635-1c') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c415635-1c, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6459a516-c0f3-45d5-9a45-a1706112ba7c) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: INFO os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:fd:70,bridge_name='br-int',has_traffic_filtering=True,id=1c415635-1c86-40b7-b0fb-9e2d3a59f99c,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c415635-1c')
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:36:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=9561b356-3304-4c7e-a845-24f13ad20859,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9561b356-33') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=9561b356-3304-4c7e-a845-24f13ad20859,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9561b356-33') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9561b356-33, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0093b193-5a33-4540-8774-c2473b6cda87) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: INFO os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:81:9e,bridge_name='br-int',has_traffic_filtering=True,id=9561b356-3304-4c7e-a845-24f13ad20859,network=Network(cc0ca23d-b28b-4f14-bdc2-175bf319fe49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9561b356-33')
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:36:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:df,bridge_name='br-int',has_traffic_filtering=True,id=8ecedd0d-0cb3-496c-a244-ddd03b914c72,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ecedd0d-0c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:df,bridge_name='br-int',has_traffic_filtering=True,id=8ecedd0d-0cb3-496c-a244-ddd03b914c72,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ecedd0d-0c') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ecedd0d-0c, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad2c0d3e-cc1e-46f9-a9ba-78268163795b) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: INFO os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:7e:df,bridge_name='br-int',has_traffic_filtering=True,id=8ecedd0d-0cb3-496c-a244-ddd03b914c72,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ecedd0d-0c')
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-962276620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-962276620',id=10,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvvUFUCZmu8uM24rTSR31J/hfhBCuqLDSRS3YMpjeLUY5mw3K5z1UvO4I+Ac3cLXvJUyPhsL45ycgiu629lGDmkeZ10Ks9701CgmXa4oufotlhT6ma9sLQAE+aq0WKfPw==',key_name='tempest-keypair-1609447894',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:36:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d848adbb2a240649bfd1f2da652cdc6',ramdisk_id='',reservation_id='r-ueykb5g5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-31976696',owner_user_name='tempest-TaggedBootDevicesTest_v242-31976696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:36:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='970b3107655b46128fb25719517d79e0',uuid=ed711b9c-3bfc-41c9-8a33-725ffa363a56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converting VIF {"id": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "address": "fa:16:3e:e5:de:2d", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba10ed3b-57", "ovs_interfaceid": "ba10ed3b-572a-4460-a5e5-597cd6dcd6af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:de:2d,bridge_name='br-int',has_traffic_filtering=True,id=ba10ed3b-572a-4460-a5e5-597cd6dcd6af,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba10ed3b-57') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:de:2d,bridge_name='br-int',has_traffic_filtering=True,id=ba10ed3b-572a-4460-a5e5-597cd6dcd6af,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba10ed3b-57') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba10ed3b-57, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4745296-860e-40aa-8784-9a43175d978d) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:13 user nova-compute[74241]: INFO os_vif [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:de:2d,bridge_name='br-int',has_traffic_filtering=True,id=ba10ed3b-572a-4460-a5e5-597cd6dcd6af,network=Network(bb369e0f-40ab-45b7-8071-ccadd6f23dc7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba10ed3b-57')
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VmfDsyMW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:38:13 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ce7975-f003-4fe0-9c59-31b2d9a49b5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]: iSNS:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]: STATIC:
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: FIRMWARE:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:38:13 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:38:13 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7095887-0d96-4249-b347-fb885202ae8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5623a656-12e5-4397-b038-b48b2ed67dcf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5240391a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1'): ({'sdh'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Removing single pathed devices sdh {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fd5fcb-ea20-42b6-b788-f4e5cb5777f0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-unplugged-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-53e1bac0-1951-49d1-9086-7c35a689302a for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: WARNING nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-53e1bac0-1951-49d1-9086-7c35a689302a for instance with vm_state active and task_state deleting.
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-unplugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: WARNING nova.compute.manager [req-f06928dd-1e08-4ace-821c-965f573fea8b req-21364cae-c2dd-4b39-8edd-7ddba12d7ccd service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-8ecedd0d-0cb3-496c-a244-ddd03b914c72 for instance with vm_state active and task_state deleting.
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ce21f5-3e4b-4474-b77e-01377a774f3c]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Flushing IO for device /dev/sdh {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[24662bb5-950f-44d8-8802-e51d1ed58930]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31553e2-0b63-440e-b6a7-87337bfedd79]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] SCSI volumes sdh have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[beae3bec-ef4e-4c0d-bb39-198c7b8c7d40]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6023bb-5de6-4d86-a93b-b337e7359077]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1, portal: 172.16.0.220,3260]
Oct 20 11:38:13 user nova-compute[74241]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1, portal: 172.16.0.220,3260] successful.
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a9000a6-adfc-4e05-9536-717f628c2fb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d9648b-cc02-412d-a829-07a3239e6506]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== disconnect_volume: return (315ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'knDSRhgU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:38:13 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43d9c7e-6d72-43cd-83bc-3e2b46810c43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]: iSNS:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]: STATIC:
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: FIRMWARE:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:38:13 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:38:13 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c97e577-697d-47cf-9dcb-ef9b2a84e85a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b0832-6881-4419-9af2-24b9f6997a80]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5240391a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d'): ({'sdg'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Removing single pathed devices sdg {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c0b886-d50c-4d37-95f2-b2ac72cca7c2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a3638-e592-4b5b-9c44-83177582790b]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Flushing IO for device /dev/sdg {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[078b0003-90f2-4acb-b1b1-3e35038aa0a4]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6946651b-1986-4db8-b4f9-78aae21fad5a]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] SCSI volumes sdg have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[659fd99d-b3c8-4648-8676-1c467d7d338a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: WARNING nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-1c415635-1c86-40b7-b0fb-9e2d3a59f99c for instance with vm_state active and task_state deleting.
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-unplugged-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-9561b356-3304-4c7e-a845-24f13ad20859 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: WARNING nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-9561b356-3304-4c7e-a845-24f13ad20859 for instance with vm_state active and task_state deleting.
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-unplugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-unplugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Acquiring lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] No waiting events found dispatching network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:13 user nova-compute[74241]: WARNING nova.compute.manager [req-3c06efd1-9121-4632-8a53-db5adad8d79e req-7f2dd77c-635a-41ed-a9f3-1eb0f46f7576 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received unexpected event network-vif-plugged-ba10ed3b-572a-4460-a5e5-597cd6dcd6af for instance with vm_state active and task_state deleting.
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd3dd76-b24b-4d79-b8a0-188e5f4b2699]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d, portal: 172.16.0.220,3260]
Oct 20 11:38:13 user nova-compute[74241]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d, portal: 172.16.0.220,3260] successful.
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f25239d-075d-415a-941b-923bad8a992d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4c5b7f-eff4-487a-aa41-1167bdf3a420]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== disconnect_volume: return (323ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuWVhOZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:38:13 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[af08ae18-6621-4964-b00f-61ecd2522819]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]: iSNS:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]: STATIC:
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:38:13 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:13 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:13 user nova-compute[74241]: FIRMWARE:
Oct 20 11:38:13 user nova-compute[74241]: No targets found.
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:38:13 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:38:13 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4475ab1f-235c-408d-81b8-cd27e4c2a61e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0265aea0-7503-42b2-9aaf-b18e1d6f5a9a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:38:13 user nova-compute[74241]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e (non-flash)
Oct 20 11:38:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5240391a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e'): ({'sdi'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Removing single pathed devices sdi {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c546aec1-a0b9-4f91-b0c0-808888a90e61]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd070c9-fb95-4c9b-acbe-d649c3ecb5d5]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Flushing IO for device /dev/sdi {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca91c3c-3cde-4628-aef9-7ff4a67785e3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:38:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9db37fb-ffa4-42c4-a46f-84ac0b620f8c]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] SCSI volumes sdi have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[503de51e-5572-4b1f-85bc-bda445898724]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d654b58-9b30-46a2-bb98-79f21f6c8564]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e, portal: 172.16.0.220,3260]
Oct 20 11:38:14 user nova-compute[74241]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e, portal: 172.16.0.220,3260] successful.
Oct 20 11:38:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:917c1204-4581-40b2-95aa-628068e87e6e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bced933c-4470-4f79-9b4b-fb4d0f730b01]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] <== disconnect_volume: return (306ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:38:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Deleting instance files /opt/stack/data/nova/instances/ed711b9c-3bfc-41c9-8a33-725ffa363a56_del
Oct 20 11:38:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Deletion of /opt/stack/data/nova/instances/ed711b9c-3bfc-41c9-8a33-725ffa363a56_del complete
Oct 20 11:38:14 user nova-compute[74241]: INFO nova.compute.manager [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Took 3.85 seconds to destroy the instance on the hypervisor.
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:14 user nova-compute[74241]: INFO nova.compute.manager [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Terminating instance
Oct 20 11:38:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Instance destroyed successfully.
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lazy-loading 'resources' on Instance uuid 726a7f29-03b0-489f-a77d-9a77e5c4a546 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T11:33:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1761481514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1761481514',id=7,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lf1BRFr45w1CWtdKPcGyrKcDPX+dW/WZNqS4j5X0vEgD8sRPAPRMXu94fdYO12qz+ML6VFaxusw/qPg6hC0DObkJPo9W8npxx2nCHVLLbyaDV1TLr2QvTQMmOSkEBaQ==',key_name='tempest-keypair-1204736846',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccb28511a3ff4f30bffdd7c8aa870c39',ramdisk_id='',reservation_id='r-lm67kk06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-20080626',owner_user_name='tempest-TaggedAttachmentsTest-20080626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16555d6cef90422db4c851511083a34f',uuid=726a7f29-03b0-489f-a77d-9a77e5c4a546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converting VIF {"id": "88fde83f-c742-460e-8d1a-78982cbb685e", "address": "fa:16:3e:ae:a1:83", "network": {"id": "5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-946245427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccb28511a3ff4f30bffdd7c8aa870c39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88fde83f-c7", "ovs_interfaceid": "88fde83f-c742-460e-8d1a-78982cbb685e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:83,bridge_name='br-int',has_traffic_filtering=True,id=88fde83f-c742-460e-8d1a-78982cbb685e,network=Network(5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88fde83f-c7') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG os_vif [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:83,bridge_name='br-int',has_traffic_filtering=True,id=88fde83f-c742-460e-8d1a-78982cbb685e,network=Network(5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88fde83f-c7') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88fde83f-c7, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0776f2b0-360b-4723-863a-2bc7c9211bfe) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:15 user nova-compute[74241]: INFO os_vif [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:a1:83,bridge_name='br-int',has_traffic_filtering=True,id=88fde83f-c742-460e-8d1a-78982cbb685e,network=Network(5b21b36f-cc1f-44b8-98dc-6b2f0fd8afeb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88fde83f-c7')
Oct 20 11:38:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Deleting instance files /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546_del
Oct 20 11:38:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Deletion of /opt/stack/data/nova/instances/726a7f29-03b0-489f-a77d-9a77e5c4a546_del complete
Oct 20 11:38:15 user nova-compute[74241]: INFO nova.compute.manager [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 20 11:38:15 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-unplugged-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] No waiting events found dispatching network-vif-unplugged-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-unplugged-88fde83f-c742-460e-8d1a-78982cbb685e for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] Acquiring lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] No waiting events found dispatching network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:15 user nova-compute[74241]: WARNING nova.compute.manager [req-27b88e98-ed29-4b8e-b323-a9b244bbf286 req-2c835006-f5e6-4a61-80a0-287f2639d0eb service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received unexpected event network-vif-plugged-88fde83f-c742-460e-8d1a-78982cbb685e for instance with vm_state active and task_state deleting.
Oct 20 11:38:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-a0c33b3d-024b-423c-a7e8-72d811ff8e23 req-bf3f4db3-ec40-468d-a92d-8f044237b12e service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-deleted-ba10ed3b-572a-4460-a5e5-597cd6dcd6af {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:16 user nova-compute[74241]: INFO nova.compute.manager [req-a0c33b3d-024b-423c-a7e8-72d811ff8e23 req-bf3f4db3-ec40-468d-a92d-8f044237b12e service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Neutron deleted interface ba10ed3b-572a-4460-a5e5-597cd6dcd6af; detaching it from the instance and deleting it from the info cache
Oct 20 11:38:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-a0c33b3d-024b-423c-a7e8-72d811ff8e23 req-bf3f4db3-ec40-468d-a92d-8f044237b12e service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [{"id": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "address": "fa:16:3e:1c:34:ff", "network": {"id": "6289f056-40bc-4716-b888-f158fb387476", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-141872119-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a371ba7-fd", "ovs_interfaceid": "3a371ba7-fd54-4cad-8a82-230fcddc7baf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-a0c33b3d-024b-423c-a7e8-72d811ff8e23 req-bf3f4db3-ec40-468d-a92d-8f044237b12e service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Detach interface failed, port_id=ba10ed3b-572a-4460-a5e5-597cd6dcd6af, reason: Instance ed711b9c-3bfc-41c9-8a33-725ffa363a56 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:38:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:17 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:17 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Took 1.63 seconds to deallocate network for instance.
Oct 20 11:38:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:38:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:38:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:17 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Deleted allocations for instance 726a7f29-03b0-489f-a77d-9a77e5c4a546
Oct 20 11:38:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b391916-42c9-4ed5-8652-7948ef0c94b8 tempest-TaggedAttachmentsTest-20080626 tempest-TaggedAttachmentsTest-20080626-project-member] Lock "726a7f29-03b0-489f-a77d-9a77e5c4a546" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.289s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-21ff682a-c305-4cce-a4e8-24d510821fda req-6114147d-2995-4ad5-ae1d-56a02ede1fd0 service nova] [instance: 726a7f29-03b0-489f-a77d-9a77e5c4a546] Received event network-vif-deleted-88fde83f-c742-460e-8d1a-78982cbb685e {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-dce58231-1a2d-45c5-8ef9-580566d8341b req-c8628550-9dd0-4e42-8ffb-da62e442711c service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-deleted-3a371ba7-fd54-4cad-8a82-230fcddc7baf {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:18 user nova-compute[74241]: INFO nova.compute.manager [req-dce58231-1a2d-45c5-8ef9-580566d8341b req-c8628550-9dd0-4e42-8ffb-da62e442711c service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Neutron deleted interface 3a371ba7-fd54-4cad-8a82-230fcddc7baf; detaching it from the instance and deleting it from the info cache
Oct 20 11:38:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-dce58231-1a2d-45c5-8ef9-580566d8341b req-c8628550-9dd0-4e42-8ffb-da62e442711c service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [{"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9561b356-3304-4c7e-a845-24f13ad20859", "address": "fa:16:3e:16:81:9e", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9561b356-33", "ovs_interfaceid": "9561b356-3304-4c7e-a845-24f13ad20859", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-dce58231-1a2d-45c5-8ef9-580566d8341b req-c8628550-9dd0-4e42-8ffb-da62e442711c service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Detach interface failed, port_id=3a371ba7-fd54-4cad-8a82-230fcddc7baf, reason: Instance ed711b9c-3bfc-41c9-8a33-725ffa363a56 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-dce58231-1a2d-45c5-8ef9-580566d8341b req-c8628550-9dd0-4e42-8ffb-da62e442711c service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-deleted-9561b356-3304-4c7e-a845-24f13ad20859 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:18 user nova-compute[74241]: INFO nova.compute.manager [req-dce58231-1a2d-45c5-8ef9-580566d8341b req-c8628550-9dd0-4e42-8ffb-da62e442711c service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Neutron deleted interface 9561b356-3304-4c7e-a845-24f13ad20859; detaching it from the instance and deleting it from the info cache
Oct 20 11:38:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-dce58231-1a2d-45c5-8ef9-580566d8341b req-c8628550-9dd0-4e42-8ffb-da62e442711c service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [{"id": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "address": "fa:16:3e:3f:74:a5", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.206", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f3bb6d7-0b", "ovs_interfaceid": "2f3bb6d7-0bd6-47af-9aff-45fb6eb9c8ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "53e1bac0-1951-49d1-9086-7c35a689302a", "address": "fa:16:3e:7c:07:2f", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.180", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53e1bac0-19", "ovs_interfaceid": "53e1bac0-1951-49d1-9086-7c35a689302a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "address": "fa:16:3e:0a:fd:70", "network": {"id": "cc0ca23d-b28b-4f14-bdc2-175bf319fe49", "bridge": "br-int", "label": "tempest-device-tagging-net1-456401429", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c415635-1c", "ovs_interfaceid": "1c415635-1c86-40b7-b0fb-9e2d3a59f99c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "address": "fa:16:3e:76:7e:df", "network": {"id": "bb369e0f-40ab-45b7-8071-ccadd6f23dc7", "bridge": "br-int", "label": "tempest-device-tagging-net2-836118452", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4d848adbb2a240649bfd1f2da652cdc6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ecedd0d-0c", "ovs_interfaceid": "8ecedd0d-0cb3-496c-a244-ddd03b914c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-dce58231-1a2d-45c5-8ef9-580566d8341b req-c8628550-9dd0-4e42-8ffb-da62e442711c service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Detach interface failed, port_id=9561b356-3304-4c7e-a845-24f13ad20859, reason: Instance ed711b9c-3bfc-41c9-8a33-725ffa363a56 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:38:18 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb is timed out.
Oct 20 11:38:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Successfully detached device vdb from instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb from the live domain config.
Oct 20 11:38:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iGgbXIAP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'c2ef804d-dc18-47c8-9809-8a29ea62bdbc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:38:18 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829806b-19af-45f6-8d80-a1f892e630b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:38:18 user nova-compute[74241]: No targets found.
Oct 20 11:38:18 user nova-compute[74241]: iSNS:
Oct 20 11:38:18 user nova-compute[74241]: No targets found.
Oct 20 11:38:18 user nova-compute[74241]: STATIC:
Oct 20 11:38:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc
Oct 20 11:38:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:38:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:38:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:38:18 user nova-compute[74241]: FIRMWARE:
Oct 20 11:38:18 user nova-compute[74241]: No targets found.
Oct 20 11:38:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:38:18 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:38:18 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6fe502-aa1f-408b-8ea0-f82e587e5c91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec2423d-ca27-4639-abba-7f6cf779c6e7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:18 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:38:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:18 user nova-compute[74241]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc (non-flash)
Oct 20 11:38:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f520866b5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc'): ({'sde'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Removing single pathed devices sde {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d34dd62-5199-4686-8c8b-ae8643239809]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e048ad6-b4fe-4295-bc1c-01b252679624]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Flushing IO for device /dev/sde {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb2c24f-2393-4c61-94e8-be475240642f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b27c784-e1a2-4941-91ba-ce1c2133811d]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed7d944-3d44-4c4b-a101-53b57ffb20cd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d658f3b-0503-463f-b981-1c23dcae4bc9]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260]
Oct 20 11:38:18 user nova-compute[74241]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc, portal: 172.16.0.220,3260] successful.
Oct 20 11:38:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2ef804d-dc18-47c8-9809-8a29ea62bdbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e44e5d4-e8c8-4211-86f0-59686e324aee]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] <== disconnect_volume: return (353ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:38:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:38:19 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:19 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Took 5.06 seconds to deallocate network for instance.
Oct 20 11:38:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-292e9051-193e-48ab-9b9d-cbf2e3558170 req-05f70730-72b5-4fed-bc43-af7de6b46f69 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-deleted-8ecedd0d-0cb3-496c-a244-ddd03b914c72 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-292e9051-193e-48ab-9b9d-cbf2e3558170 req-05f70730-72b5-4fed-bc43-af7de6b46f69 service nova] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Received event network-vif-deleted-1c415635-1c86-40b7-b0fb-9e2d3a59f99c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lazy-loading 'flavor' on Instance uuid d77d035b-ec54-4c5e-8dd6-55e5297b02fb {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:38:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-feaade6b-bffc-4080-8dd6-61d514b027ca tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.351s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:38:25 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Creating image(s)
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Ensure instance console log exists: /opt/stack/data/nova/instances/34e3ad13-abe7-4167-9d8c-474f59397b6e/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Start _get_guest_xml network_info=[{"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'e6d8ee2a-3c95-4d7f-b057-b64d88b61d3d', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34e3ad13-abe7-4167-9d8c-474f59397b6e', 'attached_at': '', 'detached_at': '', 'volume_id': '2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'serial': '2238763d-1ef0-47ab-8b4d-426b0d0d935b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:38:25 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 11:38:25 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:38:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34e3ad13-abe7-4167-9d8c-474f59397b6e {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:38:26 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:38:26 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:38:26 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fbd983-b9d4-4150-8bf1-c405f2fb687d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:38:26 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[554f92bf-8bf6-4fcd-b2a2-ff8a20988b49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b] added
Oct 20 11:38:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8315664a-a396-43e3-b5df-930a87cf8b03]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee66ff9-6bd0-4c3e-bbaa-e9757aa931f9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUxbdFNp {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RUxbdFNp" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21c97a4-b9fb-4244-90b3-4eb7145bca74]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RUxbdFNp'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf26bfd-9ab4-470e-8676-716ee4a6c6fd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0386a618-ec38-4b48-8513-3ab872e3f0c3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d3c13-8700-47f6-8b98-bfab52376954]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260]
Oct 20 11:38:26 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260] successful.
Oct 20 11:38:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92f0844-8f2d-4d6e-bdb9-283f9321d5b0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cab0eb-a993-4571-b57d-889402f589c5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:26 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:38:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:38:26 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:38:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[048d04d9-8bad-486c-8e94-48f10c28bf99]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:38:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26161633238613333', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161633238613333', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T11:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1119991789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1295570451',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaUIsowPmm/MBl/9oF/rCt+woqma1ayrQNEAD67yYMwRXAZ/8sIsCOKQwamQdDx/t/+9n1SuwVQPPyBfK/H1EhTaY9NImQ0KPlZ9u0wdeUyzHwRbNbIGnoy7DD6297w1w==',key_name='tempest-keypair-1421120003',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c453ef58eb74b0d9ae83d020931ff83',ramdisk_id='',reservation_id='r-s8k6ynmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1927240912',owner_user_name='tempest-ServerActionsV293TestJSON-1927240912-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfbfcb932abf47388e416266cd2f1098',uuid=34e3ad13-abe7-4167-9d8c-474f59397b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converting VIF {"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:38:27 user nova-compute[74241]:   <uuid>34e3ad13-abe7-4167-9d8c-474f59397b6e</uuid>
Oct 20 11:38:27 user nova-compute[74241]:   <name>instance-00000009</name>
Oct 20 11:38:27 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:38:27 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:38:27 user nova-compute[74241]:   <metadata>
Oct 20 11:38:27 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:38:27 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:38:27 user nova-compute[74241]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1119991789</nova:name>
Oct 20 11:38:27 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:38:25</nova:creationTime>
Oct 20 11:38:27 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:38:27 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:38:27 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:38:27 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:38:27 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:38:27 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:38:27 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:38:27 user nova-compute[74241]:       <nova:owner>
Oct 20 11:38:27 user nova-compute[74241]:         <nova:user uuid="bfbfcb932abf47388e416266cd2f1098">tempest-ServerActionsV293TestJSON-1927240912-project-member</nova:user>
Oct 20 11:38:27 user nova-compute[74241]:         <nova:project uuid="3c453ef58eb74b0d9ae83d020931ff83">tempest-ServerActionsV293TestJSON-1927240912</nova:project>
Oct 20 11:38:27 user nova-compute[74241]:       </nova:owner>
Oct 20 11:38:27 user nova-compute[74241]:       <nova:ports>
Oct 20 11:38:27 user nova-compute[74241]:         <nova:port uuid="f3ee0369-7aca-4c21-8798-c9158cc47bec">
Oct 20 11:38:27 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:38:27 user nova-compute[74241]:         </nova:port>
Oct 20 11:38:27 user nova-compute[74241]:       </nova:ports>
Oct 20 11:38:27 user nova-compute[74241]:     </nova:instance>
Oct 20 11:38:27 user nova-compute[74241]:   </metadata>
Oct 20 11:38:27 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:38:27 user nova-compute[74241]:     <system>
Oct 20 11:38:27 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:38:27 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:38:27 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:38:27 user nova-compute[74241]:       <entry name="serial">34e3ad13-abe7-4167-9d8c-474f59397b6e</entry>
Oct 20 11:38:27 user nova-compute[74241]:       <entry name="uuid">34e3ad13-abe7-4167-9d8c-474f59397b6e</entry>
Oct 20 11:38:27 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:38:27 user nova-compute[74241]:     </system>
Oct 20 11:38:27 user nova-compute[74241]:   </sysinfo>
Oct 20 11:38:27 user nova-compute[74241]:   <os>
Oct 20 11:38:27 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:38:27 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:38:27 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:38:27 user nova-compute[74241]:   </os>
Oct 20 11:38:27 user nova-compute[74241]:   <features>
Oct 20 11:38:27 user nova-compute[74241]:     <acpi/>
Oct 20 11:38:27 user nova-compute[74241]:     <apic/>
Oct 20 11:38:27 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:38:27 user nova-compute[74241]:   </features>
Oct 20 11:38:27 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:38:27 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:38:27 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:38:27 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:38:27 user nova-compute[74241]:   </clock>
Oct 20 11:38:27 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:38:27 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:38:27 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:38:27 user nova-compute[74241]:   </cpu>
Oct 20 11:38:27 user nova-compute[74241]:   <devices>
Oct 20 11:38:27 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:38:27 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:38:27 user nova-compute[74241]:       <source dev="/dev/sdb"/>
Oct 20 11:38:27 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:38:27 user nova-compute[74241]:       <serial>2238763d-1ef0-47ab-8b4d-426b0d0d935b</serial>
Oct 20 11:38:27 user nova-compute[74241]:     </disk>
Oct 20 11:38:27 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:38:27 user nova-compute[74241]:       <mac address="fa:16:3e:68:93:2a"/>
Oct 20 11:38:27 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:38:27 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:38:27 user nova-compute[74241]:       <target dev="tapf3ee0369-7a"/>
Oct 20 11:38:27 user nova-compute[74241]:     </interface>
Oct 20 11:38:27 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:38:27 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/34e3ad13-abe7-4167-9d8c-474f59397b6e/console.log" append="off"/>
Oct 20 11:38:27 user nova-compute[74241]:     </serial>
Oct 20 11:38:27 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:38:27 user nova-compute[74241]:     <video>
Oct 20 11:38:27 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:38:27 user nova-compute[74241]:     </video>
Oct 20 11:38:27 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:38:27 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:38:27 user nova-compute[74241]:     </rng>
Oct 20 11:38:27 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:38:27 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:38:27 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:38:27 user nova-compute[74241]:     </memballoon>
Oct 20 11:38:27 user nova-compute[74241]:   </devices>
Oct 20 11:38:27 user nova-compute[74241]: </domain>
Oct 20 11:38:27 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T11:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1119991789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1295570451',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaUIsowPmm/MBl/9oF/rCt+woqma1ayrQNEAD67yYMwRXAZ/8sIsCOKQwamQdDx/t/+9n1SuwVQPPyBfK/H1EhTaY9NImQ0KPlZ9u0wdeUyzHwRbNbIGnoy7DD6297w1w==',key_name='tempest-keypair-1421120003',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3c453ef58eb74b0d9ae83d020931ff83',ramdisk_id='',reservation_id='r-s8k6ynmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1927240912',owner_user_name='tempest-ServerActionsV293TestJSON-1927240912-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:37:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfbfcb932abf47388e416266cd2f1098',uuid=34e3ad13-abe7-4167-9d8c-474f59397b6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converting VIF {"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG os_vif [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7bfc8a9-de90-5095-83d2-c5526f39c9da', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3ee0369-7a, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3ee0369-7a, col_values=(('qos', UUID('86037b4b-b0a4-452e-8117-f1bc23d40eee')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3ee0369-7a, col_values=(('external_ids', {'iface-id': 'f3ee0369-7aca-4c21-8798-c9158cc47bec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:93:2a', 'vm-uuid': '34e3ad13-abe7-4167-9d8c-474f59397b6e'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:27 user nova-compute[74241]: INFO os_vif [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a')
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:38:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] No VIF found with MAC fa:16:3e:68:93:2a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:38:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-fee360d9-4453-41cf-9f55-bf7a4a841372 req-924ac80a-7c82-4986-8705-a081516a9f80 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fee360d9-4453-41cf-9f55-bf7a4a841372 req-924ac80a-7c82-4986-8705-a081516a9f80 service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fee360d9-4453-41cf-9f55-bf7a4a841372 req-924ac80a-7c82-4986-8705-a081516a9f80 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fee360d9-4453-41cf-9f55-bf7a4a841372 req-924ac80a-7c82-4986-8705-a081516a9f80 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-fee360d9-4453-41cf-9f55-bf7a4a841372 req-924ac80a-7c82-4986-8705-a081516a9f80 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] No waiting events found dispatching network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:29 user nova-compute[74241]: WARNING nova.compute.manager [req-fee360d9-4453-41cf-9f55-bf7a4a841372 req-924ac80a-7c82-4986-8705-a081516a9f80 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received unexpected event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec for instance with vm_state active and task_state rebuild_spawning.
Oct 20 11:38:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:38:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:38:30 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance spawned successfully.
Oct 20 11:38:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74241) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-9b73b644-e928-49a4-a2e1-90b64cedcf38 req-31fa7b6b-4166-4595-acd4-c9d85f5836e6 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9b73b644-e928-49a4-a2e1-90b64cedcf38 req-31fa7b6b-4166-4595-acd4-c9d85f5836e6 service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9b73b644-e928-49a4-a2e1-90b64cedcf38 req-31fa7b6b-4166-4595-acd4-c9d85f5836e6 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9b73b644-e928-49a4-a2e1-90b64cedcf38 req-31fa7b6b-4166-4595-acd4-c9d85f5836e6 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-9b73b644-e928-49a4-a2e1-90b64cedcf38 req-31fa7b6b-4166-4595-acd4-c9d85f5836e6 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] No waiting events found dispatching network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:31 user nova-compute[74241]: WARNING nova.compute.manager [req-9b73b644-e928-49a4-a2e1-90b64cedcf38 req-31fa7b6b-4166-4595-acd4-c9d85f5836e6 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received unexpected event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec for instance with vm_state active and task_state None.
Oct 20 11:38:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e600e7e3-46de-48ae-8f4c-f096effc55fb tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 11:38:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 11:38:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:38:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:38:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:38:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:38:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:47 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:47 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:47 user nova-compute[74241]: INFO nova.compute.manager [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Terminating instance
Oct 20 11:38:47 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-f26bd9a9-4a89-4f6a-8efd-fd3cff84681f req-eab5ba83-9667-4b53-a3f4-7442481e4499 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received event network-vif-unplugged-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f26bd9a9-4a89-4f6a-8efd-fd3cff84681f req-eab5ba83-9667-4b53-a3f4-7442481e4499 service nova] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f26bd9a9-4a89-4f6a-8efd-fd3cff84681f req-eab5ba83-9667-4b53-a3f4-7442481e4499 service nova] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f26bd9a9-4a89-4f6a-8efd-fd3cff84681f req-eab5ba83-9667-4b53-a3f4-7442481e4499 service nova] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-f26bd9a9-4a89-4f6a-8efd-fd3cff84681f req-eab5ba83-9667-4b53-a3f4-7442481e4499 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] No waiting events found dispatching network-vif-unplugged-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-f26bd9a9-4a89-4f6a-8efd-fd3cff84681f req-eab5ba83-9667-4b53-a3f4-7442481e4499 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received event network-vif-unplugged-8604e215-a83b-4c89-8bea-f37fcc7683cc for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:38:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Instance destroyed successfully.
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lazy-loading 'resources' on Instance uuid d77d035b-ec54-4c5e-8dd6-55e5297b02fb {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2082572523',display_name='tempest-TestVolumeSwap-server-2082572523',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2082572523',id=5,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMW9xBWk87YorZXs2mmeENWsFyTAQUMAccB3btT++i8j7X1MiTqzOi8YmrTxVeDk6nZ6O9fUI6zg8jchTr3DQHDbyCe7nhH5zyqzDrMFkcWXiZG/qyo4j84HplPGEz2dA==',key_name='tempest-keypair-528041587',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846710235ea147a09c582fe0709848e9',ramdisk_id='',reservation_id='r-u6hpwyvp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1188959597',owner_user_name='tempest-TestVolumeSwap-1188959597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54ab4dcd0a5c44f1a3cf8f56918dba0b',uuid=d77d035b-ec54-4c5e-8dd6-55e5297b02fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Converting VIF {"id": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "address": "fa:16:3e:34:a8:80", "network": {"id": "efd33a9d-b3fe-4345-8299-83f4765626a4", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1971747770-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846710235ea147a09c582fe0709848e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8604e215-a8", "ovs_interfaceid": "8604e215-a83b-4c89-8bea-f37fcc7683cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:a8:80,bridge_name='br-int',has_traffic_filtering=True,id=8604e215-a83b-4c89-8bea-f37fcc7683cc,network=Network(efd33a9d-b3fe-4345-8299-83f4765626a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8604e215-a8') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG os_vif [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:a8:80,bridge_name='br-int',has_traffic_filtering=True,id=8604e215-a83b-4c89-8bea-f37fcc7683cc,network=Network(efd33a9d-b3fe-4345-8299-83f4765626a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8604e215-a8') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8604e215-a8, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7fd71a2-1d84-4172-aeca-08751ca3f237) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:48 user nova-compute[74241]: INFO os_vif [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:a8:80,bridge_name='br-int',has_traffic_filtering=True,id=8604e215-a83b-4c89-8bea-f37fcc7683cc,network=Network(efd33a9d-b3fe-4345-8299-83f4765626a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8604e215-a8')
Oct 20 11:38:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Deleting instance files /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb_del
Oct 20 11:38:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Deletion of /opt/stack/data/nova/instances/d77d035b-ec54-4c5e-8dd6-55e5297b02fb_del complete
Oct 20 11:38:48 user nova-compute[74241]: INFO nova.compute.manager [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:38:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:49 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Took 1.01 seconds to deallocate network for instance.
Oct 20 11:38:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-3411752a-87fa-471c-a594-8e5d4d4dcd11 req-6f75f902-5062-4cee-8c77-30cf5eb6000e service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received event network-vif-deleted-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:49 user nova-compute[74241]: INFO nova.compute.manager [req-3411752a-87fa-471c-a594-8e5d4d4dcd11 req-6f75f902-5062-4cee-8c77-30cf5eb6000e service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Neutron deleted interface 8604e215-a83b-4c89-8bea-f37fcc7683cc; detaching it from the instance and deleting it from the info cache
Oct 20 11:38:49 user nova-compute[74241]: DEBUG nova.network.neutron [req-3411752a-87fa-471c-a594-8e5d4d4dcd11 req-6f75f902-5062-4cee-8c77-30cf5eb6000e service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-3411752a-87fa-471c-a594-8e5d4d4dcd11 req-6f75f902-5062-4cee-8c77-30cf5eb6000e service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Detach interface failed, port_id=8604e215-a83b-4c89-8bea-f37fcc7683cc, reason: Instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c88cf71-bf1e-49b2-a5d3-cfef8288addd req-a096851f-3f1a-4ba7-9d01-242d0574ee63 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received event network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c88cf71-bf1e-49b2-a5d3-cfef8288addd req-a096851f-3f1a-4ba7-9d01-242d0574ee63 service nova] Acquiring lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c88cf71-bf1e-49b2-a5d3-cfef8288addd req-a096851f-3f1a-4ba7-9d01-242d0574ee63 service nova] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c88cf71-bf1e-49b2-a5d3-cfef8288addd req-a096851f-3f1a-4ba7-9d01-242d0574ee63 service nova] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c88cf71-bf1e-49b2-a5d3-cfef8288addd req-a096851f-3f1a-4ba7-9d01-242d0574ee63 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] No waiting events found dispatching network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:38:50 user nova-compute[74241]: WARNING nova.compute.manager [req-2c88cf71-bf1e-49b2-a5d3-cfef8288addd req-a096851f-3f1a-4ba7-9d01-242d0574ee63 service nova] [instance: d77d035b-ec54-4c5e-8dd6-55e5297b02fb] Received unexpected event network-vif-plugged-8604e215-a83b-4c89-8bea-f37fcc7683cc for instance with vm_state deleted and task_state None.
Oct 20 11:38:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Error from libvirt while getting description of instance-00000005: [Error Code 42] Domain not found: no domain with matching uuid 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb' (instance-00000005): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd77d035b-ec54-4c5e-8dd6-55e5297b02fb' (instance-00000005)
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.586s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:50 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Deleted allocations for instance d77d035b-ec54-4c5e-8dd6-55e5297b02fb
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88f991c-fa23-486c-8179-42ed25a53768 tempest-TestVolumeSwap-1188959597 tempest-TestVolumeSwap-1188959597-project-member] Lock "d77d035b-ec54-4c5e-8dd6-55e5297b02fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.825s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:38:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:52 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:38:52 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7693MB free_disk=25.49506378173828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 34e3ad13-abe7-4167-9d8c-474f59397b6e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ed711b9c-3bfc-41c9-8a33-725ffa363a56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance c19279cb-daa2-491e-8288-e0f2ce35dc1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 2e3d3300-5e5c-4de7-8178-8342ad15a06b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 217655bc-d22a-4c39-9522-29f189a6bb5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.manager [req-2804d31b-06c7-4705-9a4c-62d40a8d9ad6 req-49d404ec-2e39-464c-a8db-d5bb05ce2654 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-changed-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.manager [req-2804d31b-06c7-4705-9a4c-62d40a8d9ad6 req-49d404ec-2e39-464c-a8db-d5bb05ce2654 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Refreshing instance network info cache due to event network-changed-bca45587-745d-4a9a-82bd-17d504fa1d16. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2804d31b-06c7-4705-9a4c-62d40a8d9ad6 req-49d404ec-2e39-464c-a8db-d5bb05ce2654 service nova] Acquiring lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2804d31b-06c7-4705-9a4c-62d40a8d9ad6 req-49d404ec-2e39-464c-a8db-d5bb05ce2654 service nova] Acquired lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-2804d31b-06c7-4705-9a4c-62d40a8d9ad6 req-49d404ec-2e39-464c-a8db-d5bb05ce2654 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Refreshing network info cache for port bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 11:38:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG nova.network.neutron [req-2804d31b-06c7-4705-9a4c-62d40a8d9ad6 req-49d404ec-2e39-464c-a8db-d5bb05ce2654 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updated VIF entry in instance network info cache for port bca45587-745d-4a9a-82bd-17d504fa1d16. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG nova.network.neutron [req-2804d31b-06c7-4705-9a4c-62d40a8d9ad6 req-49d404ec-2e39-464c-a8db-d5bb05ce2654 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updating instance_info_cache with network_info: [{"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2804d31b-06c7-4705-9a4c-62d40a8d9ad6 req-49d404ec-2e39-464c-a8db-d5bb05ce2654 service nova] Releasing lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG nova.objects.instance [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'flavor' on Instance uuid c19279cb-daa2-491e-8288-e0f2ce35dc1b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:53 user nova-compute[74241]: INFO nova.compute.manager [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Attaching volume daa4dbd3-121d-416b-8070-2e3b8616b91f to /dev/vdb
Oct 20 11:38:53 user nova-compute[74241]: DEBUG os_brick.utils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71288a5-8019-462f-b5f1-dd402e1eaabb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff68244c-66ea-453f-8409-e619fef1c3cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e452f6ce-c6e9-451c-9d79-adeebdd53257]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f8d6d4-aef7-4450-b880-5a7f29513647]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:38:53 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:38:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab89238-1506-4269-a3ee-01a45eb8de18]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG os_brick.utils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updating existing volume attachment record: f0fbaa8c-abe1-4eaa-8727-bc6c2283ec20 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:38:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:38:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 11:38:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:38:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:38:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:58 user nova-compute[74241]: INFO nova.compute.manager [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] [instance: ed711b9c-3bfc-41c9-8a33-725ffa363a56] Took 39.40 seconds to detach 3 volumes for instance.
Oct 20 11:38:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:38:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:38:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:38:58 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:38:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:38:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:38:59 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Deleted allocations for instance ed711b9c-3bfc-41c9-8a33-725ffa363a56
Oct 20 11:38:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c99c2d3e-b610-4020-9a69-fb6d68375437 tempest-TaggedBootDevicesTest_v242-31976696 tempest-TaggedBootDevicesTest_v242-31976696-project-member] Lock "ed711b9c-3bfc-41c9-8a33-725ffa363a56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 48.831s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:17 user nova-compute[74241]: INFO nova.compute.manager [None req-fcb09639-726d-4c70-af4c-bfe9831dfd75 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Unrescuing
Oct 20 11:39:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fcb09639-726d-4c70-af4c-bfe9831dfd75 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:39:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fcb09639-726d-4c70-af4c-bfe9831dfd75 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:39:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fcb09639-726d-4c70-af4c-bfe9831dfd75 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fcb09639-726d-4c70-af4c-bfe9831dfd75 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fcb09639-726d-4c70-af4c-bfe9831dfd75 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG nova.objects.instance [None req-fcb09639-726d-4c70-af4c-bfe9831dfd75 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'flavor' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-131fd3ef-c0a9-45f8-a614-a857a46ebdfd req-aa6d38d0-2eaa-4ac4-bde6-bd836716de7d service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-131fd3ef-c0a9-45f8-a614-a857a46ebdfd req-aa6d38d0-2eaa-4ac4-bde6-bd836716de7d service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-131fd3ef-c0a9-45f8-a614-a857a46ebdfd req-aa6d38d0-2eaa-4ac4-bde6-bd836716de7d service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-131fd3ef-c0a9-45f8-a614-a857a46ebdfd req-aa6d38d0-2eaa-4ac4-bde6-bd836716de7d service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-131fd3ef-c0a9-45f8-a614-a857a46ebdfd req-aa6d38d0-2eaa-4ac4-bde6-bd836716de7d service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:39:18 user nova-compute[74241]: WARNING nova.compute.manager [req-131fd3ef-c0a9-45f8-a614-a857a46ebdfd req-aa6d38d0-2eaa-4ac4-bde6-bd836716de7d service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:39:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-07de8275-bfb5-4bfc-a612-b0c7f70a7ce2 req-079a9f24-53d3-4d69-bca4-68d064ea3e6e service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-changed-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-07de8275-bfb5-4bfc-a612-b0c7f70a7ce2 req-079a9f24-53d3-4d69-bca4-68d064ea3e6e service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Refreshing instance network info cache due to event network-changed-08303d9d-06cf-4e8a-a348-f1475340cb3c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:39:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-07de8275-bfb5-4bfc-a612-b0c7f70a7ce2 req-079a9f24-53d3-4d69-bca4-68d064ea3e6e service nova] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:39:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-07de8275-bfb5-4bfc-a612-b0c7f70a7ce2 req-079a9f24-53d3-4d69-bca4-68d064ea3e6e service nova] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:39:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-07de8275-bfb5-4bfc-a612-b0c7f70a7ce2 req-079a9f24-53d3-4d69-bca4-68d064ea3e6e service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Refreshing network info cache for port 08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:39:19 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance destroyed successfully.
Oct 20 11:39:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-07de8275-bfb5-4bfc-a612-b0c7f70a7ce2 req-079a9f24-53d3-4d69-bca4-68d064ea3e6e service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updated VIF entry in instance network info cache for port 08303d9d-06cf-4e8a-a348-f1475340cb3c. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:39:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-07de8275-bfb5-4bfc-a612-b0c7f70a7ce2 req-079a9f24-53d3-4d69-bca4-68d064ea3e6e service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:39:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-07de8275-bfb5-4bfc-a612-b0c7f70a7ce2 req-079a9f24-53d3-4d69-bca4-68d064ea3e6e service nova] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-f83a75bd-94f1-4adf-b623-8c09974b2c24 req-3a90abaf-6e4f-4c1e-beb4-6518c79b834a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f83a75bd-94f1-4adf-b623-8c09974b2c24 req-3a90abaf-6e4f-4c1e-beb4-6518c79b834a service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f83a75bd-94f1-4adf-b623-8c09974b2c24 req-3a90abaf-6e4f-4c1e-beb4-6518c79b834a service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f83a75bd-94f1-4adf-b623-8c09974b2c24 req-3a90abaf-6e4f-4c1e-beb4-6518c79b834a service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-f83a75bd-94f1-4adf-b623-8c09974b2c24 req-3a90abaf-6e4f-4c1e-beb4-6518c79b834a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:39:20 user nova-compute[74241]: WARNING nova.compute.manager [req-f83a75bd-94f1-4adf-b623-8c09974b2c24 req-3a90abaf-6e4f-4c1e-beb4-6518c79b834a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:39:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-958ba0fd-a888-47c8-96b3-cc8ce2e828e4 req-1cfab466-d832-4b02-87f8-e7c5a0c9f419 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-changed-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-958ba0fd-a888-47c8-96b3-cc8ce2e828e4 req-1cfab466-d832-4b02-87f8-e7c5a0c9f419 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Refreshing instance network info cache due to event network-changed-08303d9d-06cf-4e8a-a348-f1475340cb3c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:39:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-958ba0fd-a888-47c8-96b3-cc8ce2e828e4 req-1cfab466-d832-4b02-87f8-e7c5a0c9f419 service nova] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:39:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-958ba0fd-a888-47c8-96b3-cc8ce2e828e4 req-1cfab466-d832-4b02-87f8-e7c5a0c9f419 service nova] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:39:21 user nova-compute[74241]: DEBUG nova.network.neutron [req-958ba0fd-a888-47c8-96b3-cc8ce2e828e4 req-1cfab466-d832-4b02-87f8-e7c5a0c9f419 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Refreshing network info cache for port 08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:39:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:22 user nova-compute[74241]: DEBUG nova.network.neutron [req-958ba0fd-a888-47c8-96b3-cc8ce2e828e4 req-1cfab466-d832-4b02-87f8-e7c5a0c9f419 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updated VIF entry in instance network info cache for port 08303d9d-06cf-4e8a-a348-f1475340cb3c. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:39:22 user nova-compute[74241]: DEBUG nova.network.neutron [req-958ba0fd-a888-47c8-96b3-cc8ce2e828e4 req-1cfab466-d832-4b02-87f8-e7c5a0c9f419 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:39:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-958ba0fd-a888-47c8-96b3-cc8ce2e828e4 req-1cfab466-d832-4b02-87f8-e7c5a0c9f419 service nova] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:39:23 user nova-compute[74241]: WARNING nova.compute.manager [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:39:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:39:23 user nova-compute[74241]: WARNING nova.compute.manager [req-351fe067-f227-406d-84f8-56e1ef64339a req-f1fa8fc6-1ea4-4744-8669-5eadfbb9829a service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:39:23 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fcb09639-726d-4c70-af4c-bfe9831dfd75 tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:39:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJZEtANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:39:34 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:39:34 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:39:34 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e37dfc-5988-49b7-9ba6-45880b76355d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:39:34 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[de707916-c06c-468f-88b6-8f3e3164ae1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f] added
Oct 20 11:39:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29a0c8-ecba-48fa-9931-5979e85db8b6]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d183704f-b99f-4897-89ee-52720faaf4ad]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJZEtANr {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJZEtANr" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc26b57-2717-471d-b540-8b2fe0a0f497]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jJZEtANr'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[df52ec44-7aa7-4984-a07c-69959eb43f6a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ff840e-d221-414c-93b0-c69947cf8bcb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:39:34 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:39:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:39:34 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:39:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7029950-e4bd-4d83-8035-67e0a7fb8490]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260]
Oct 20 11:39:34 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260] successful.
Oct 20 11:39:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[778d8020-cddc-4198-b239-697e4e4b4508]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[97aee569-6ea4-45d3-a026-1f851355ff28]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:39:34 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:39:34 user nova-compute[74241]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:39:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:39:34 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:39:34 user nova-compute[74241]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:39:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a6188-0b8a-4ea7-8f47-729b139b3388]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:39:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJZEtANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:39:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:39:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26165396232373434', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:39:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165396232373434', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:39:35 user nova-compute[74241]: DEBUG nova.objects.instance [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'flavor' on Instance uuid c19279cb-daa2-491e-8288-e0f2ce35dc1b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:39:36 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:39:36 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:39:36 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:39:36 user nova-compute[74241]:   <serial>daa4dbd3-121d-416b-8070-2e3b8616b91f</serial>
Oct 20 11:39:36 user nova-compute[74241]: </disk>
Oct 20 11:39:36 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No VIF found with MAC fa:16:3e:74:36:99, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ac301b2e-7ed9-4746-bdea-4e251de8b3f1 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.315s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid f289e23f-cab7-4631-9c80-6b0391bbea89 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid c19279cb-daa2-491e-8288-e0f2ce35dc1b {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 2e3d3300-5e5c-4de7-8178-8342ad15a06b {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 217655bc-d22a-4c39-9522-29f189a6bb5f {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 34e3ad13-abe7-4167-9d8c-474f59397b6e {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.142s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.175s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.178s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:37 user nova-compute[74241]: INFO nova.compute.manager [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Rebuilding instance
Oct 20 11:39:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:39:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance destroyed successfully.
Oct 20 11:39:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-dc867e2c-7cf1-43ee-8f16-098fef4e0b76 req-04faf734-cb64-4649-917b-8ae605b3e835 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-unplugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-dc867e2c-7cf1-43ee-8f16-098fef4e0b76 req-04faf734-cb64-4649-917b-8ae605b3e835 service nova] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-dc867e2c-7cf1-43ee-8f16-098fef4e0b76 req-04faf734-cb64-4649-917b-8ae605b3e835 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-dc867e2c-7cf1-43ee-8f16-098fef4e0b76 req-04faf734-cb64-4649-917b-8ae605b3e835 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-dc867e2c-7cf1-43ee-8f16-098fef4e0b76 req-04faf734-cb64-4649-917b-8ae605b3e835 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] No waiting events found dispatching network-vif-unplugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:39:39 user nova-compute[74241]: WARNING nova.compute.manager [req-dc867e2c-7cf1-43ee-8f16-098fef4e0b76 req-04faf734-cb64-4649-917b-8ae605b3e835 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received unexpected event network-vif-unplugged-bca45587-745d-4a9a-82bd-17d504fa1d16 for instance with vm_state active and task_state rebuilding.
Oct 20 11:39:39 user nova-compute[74241]: INFO nova.compute.manager [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Detaching volume daa4dbd3-121d-416b-8070-2e3b8616b91f
Oct 20 11:39:39 user nova-compute[74241]: INFO nova.virt.block_device [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Attempting to driver detach volume daa4dbd3-121d-416b-8070-2e3b8616b91f from mountpoint /dev/vdb
Oct 20 11:39:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Attempting to detach device vdb from instance c19279cb-daa2-491e-8288-e0f2ce35dc1b from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:39:39 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:39:39 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:39:39 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:39:39 user nova-compute[74241]:   <serial>daa4dbd3-121d-416b-8070-2e3b8616b91f</serial>
Oct 20 11:39:39 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:39:39 user nova-compute[74241]: </disk>
Oct 20 11:39:39 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:39:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully detached device vdb from instance c19279cb-daa2-491e-8288-e0f2ce35dc1b from the persistent domain config.
Oct 20 11:39:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJZEtANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:39:39 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[02823c11-f658-430b-b11f-f672eea9ee4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:39:39 user nova-compute[74241]: No targets found.
Oct 20 11:39:39 user nova-compute[74241]: iSNS:
Oct 20 11:39:39 user nova-compute[74241]: No targets found.
Oct 20 11:39:39 user nova-compute[74241]: STATIC:
Oct 20 11:39:39 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b
Oct 20 11:39:39 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:39:39 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:39:39 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f
Oct 20 11:39:39 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:39:39 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:39:39 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:39:39 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:39:39 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:39:39 user nova-compute[74241]: FIRMWARE:
Oct 20 11:39:39 user nova-compute[74241]: No targets found.
Oct 20 11:39:39 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:39:39 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:39:39 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd46358-4d4f-4fba-8d57-4e625d30c3f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1390c25c-fd3a-42b3-89a4-d5e2c08ccd11]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:39:39 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:39:39 user nova-compute[74241]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:39:39 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:39:39 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:39:39 user nova-compute[74241]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:39:39 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5208618550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1fe82e-30ca-45ac-9ec2-eae7cefe9570]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cc59e1-7a03-4591-87f8-139f889c6dfb]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b96de3-3cfb-42c3-8d66-c070ab2850da]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d87b14b-a52a-4c64-bede-0a3706aa9688]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd1754d-3cac-4707-9163-4aab8e90ecd3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[204f0655-881b-486c-b20e-bc1a55b9cd20]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260]
Oct 20 11:39:39 user nova-compute[74241]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260] successful.
Oct 20 11:39:39 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[88018b62-fb75-440e-b2b3-330e69101729]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== disconnect_volume: return (341ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:39:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance destroyed successfully.
Oct 20 11:39:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-325758242',display_name='tempest-ServerActionsTestOtherA-server-1809989271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-325758242',id=12,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfdRRJbVskDjUThR/IvsP9b1m3vihpGe7aDy8UUiNypatNlCMWiRW9yckmulY6+ixramzXREUBSZQPfWajqoa/vgaSkHTU6CP3WpmBYFOXyTjhpz8m1yETa+pNT54qdoA==',key_name='tempest-keypair-1196191213',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:37:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-a1kpnac2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:39:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=c19279cb-daa2-491e-8288-e0f2ce35dc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_vif [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbca45587-74, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a1f3531-0fe6-4c1b-b438-d95fe481c94a) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:40 user nova-compute[74241]: INFO os_vif [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74')
Oct 20 11:39:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJZEtANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:39:40 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cc2b6a-19a7-4a68-a04f-ce7c58b22eed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:39:40 user nova-compute[74241]: No targets found.
Oct 20 11:39:40 user nova-compute[74241]: iSNS:
Oct 20 11:39:40 user nova-compute[74241]: No targets found.
Oct 20 11:39:40 user nova-compute[74241]: STATIC:
Oct 20 11:39:40 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b
Oct 20 11:39:40 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:39:40 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:39:40 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:39:40 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:39:40 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:39:40 user nova-compute[74241]: FIRMWARE:
Oct 20 11:39:40 user nova-compute[74241]: No targets found.
Oct 20 11:39:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:39:40 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:39:40 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adc02fb-4f75-4411-b314-661c3f03c7f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db709e7-e655-40bf-82af-0507d80a926b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:39:40 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:39:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:39:40 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:39:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52086572e0>, {}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Disconnecting from: [] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.105s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== disconnect_volume: return (106ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:39:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:39:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Deleting instance files /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b_del
Oct 20 11:39:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Deletion of /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b_del complete
Oct 20 11:39:40 user nova-compute[74241]: INFO nova.virt.block_device [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Booting with volume daa4dbd3-121d-416b-8070-2e3b8616b91f at /dev/vdb
Oct 20 11:39:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8448a6ef-7648-4f19-a0a7-493bf4736081]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e999b-6f58-4307-ac0e-9e6d329a39c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-ab4d6f0d-a51d-47c0-932d-8c258f9a9c21 req-3667b504-ef6b-48d2-94f2-5b78b10325b7 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ab4d6f0d-a51d-47c0-932d-8c258f9a9c21 req-3667b504-ef6b-48d2-94f2-5b78b10325b7 service nova] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ab4d6f0d-a51d-47c0-932d-8c258f9a9c21 req-3667b504-ef6b-48d2-94f2-5b78b10325b7 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ab4d6f0d-a51d-47c0-932d-8c258f9a9c21 req-3667b504-ef6b-48d2-94f2-5b78b10325b7 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-ab4d6f0d-a51d-47c0-932d-8c258f9a9c21 req-3667b504-ef6b-48d2-94f2-5b78b10325b7 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] No waiting events found dispatching network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:39:41 user nova-compute[74241]: WARNING nova.compute.manager [req-ab4d6f0d-a51d-47c0-932d-8c258f9a9c21 req-3667b504-ef6b-48d2-94f2-5b78b10325b7 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received unexpected event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce0328-f9bc-4953-94e1-9c4aafdb37d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[749ab89a-19c0-4e86-bf85-006805664249]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:39:41 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:39:41 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d15fdb-8c3e-4f46-a1ae-f9482dc7839a]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG os_brick.utils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:39:41 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updating existing volume attachment record: 40fbb536-3d59-46cb-94fe-a7016b9e340b {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:39:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-4680c428-43dd-4aef-9553-02a896bf48fe req-329e48f6-70ab-4194-958f-f381649eaa6c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-changed-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-4680c428-43dd-4aef-9553-02a896bf48fe req-329e48f6-70ab-4194-958f-f381649eaa6c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Refreshing instance network info cache due to event network-changed-4e6456d2-605c-4ddb-a205-06de64ae7c77. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4680c428-43dd-4aef-9553-02a896bf48fe req-329e48f6-70ab-4194-958f-f381649eaa6c service nova] Acquiring lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4680c428-43dd-4aef-9553-02a896bf48fe req-329e48f6-70ab-4194-958f-f381649eaa6c service nova] Acquired lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG nova.network.neutron [req-4680c428-43dd-4aef-9553-02a896bf48fe req-329e48f6-70ab-4194-958f-f381649eaa6c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Refreshing network info cache for port 4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:39:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG nova.network.neutron [req-4680c428-43dd-4aef-9553-02a896bf48fe req-329e48f6-70ab-4194-958f-f381649eaa6c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updated VIF entry in instance network info cache for port 4e6456d2-605c-4ddb-a205-06de64ae7c77. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG nova.network.neutron [req-4680c428-43dd-4aef-9553-02a896bf48fe req-329e48f6-70ab-4194-958f-f381649eaa6c service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updating instance_info_cache with network_info: [{"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4680c428-43dd-4aef-9553-02a896bf48fe req-329e48f6-70ab-4194-958f-f381649eaa6c service nova] Releasing lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:39:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:51 user nova-compute[74241]: INFO nova.compute.manager [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Detaching volume 55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:39:51 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:39:51 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:39:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7974MB free_disk=25.52817153930664GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:51 user nova-compute[74241]: INFO nova.virt.block_device [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Attempting to driver detach volume 55d0f928-afff-41a0-b970-021ed8f154b6 from mountpoint /dev/vdb
Oct 20 11:39:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Attempting to detach device vdb from instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:39:51 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:39:51 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:39:51 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:39:51 user nova-compute[74241]:   <serial>55d0f928-afff-41a0-b970-021ed8f154b6</serial>
Oct 20 11:39:51 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:39:51 user nova-compute[74241]: </disk>
Oct 20 11:39:51 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:39:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Successfully detached device vdb from instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a from the persistent domain config.
Oct 20 11:39:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:39:51 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:39:51 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:39:51 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:39:51 user nova-compute[74241]:   <serial>55d0f928-afff-41a0-b970-021ed8f154b6</serial>
Oct 20 11:39:51 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:39:51 user nova-compute[74241]: </disk>
Oct 20 11:39:51 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:39:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 34e3ad13-abe7-4167-9d8c-474f59397b6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance c19279cb-daa2-491e-8288-e0f2ce35dc1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 2e3d3300-5e5c-4de7-8178-8342ad15a06b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 217655bc-d22a-4c39-9522-29f189a6bb5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.811s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:39:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:39:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:39:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:39:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:39:53 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:39:53 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [{"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG nova.objects.instance [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 217655bc-d22a-4c39-9522-29f189a6bb5f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-95bf8c4c-21a0-462c-a370-eedd74d6fc1a" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:54 user nova-compute[74241]: INFO nova.compute.manager [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Attaching volume cbb88370-8b6c-4dea-97a1-53745fb93e07 to /dev/vdb
Oct 20 11:39:54 user nova-compute[74241]: DEBUG os_brick.utils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[16066cd0-c927-4a84-94a5-a6ece7f127e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb36aa7a-e510-4458-91cf-ec5da6ea4d3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef090cc7-36c6-42fa-9ad1-dc538c6af7d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04d48c8-4bf1-4b68-b93f-0292fa6c2d82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:39:55 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:39:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3d0879-5d41-4a49-ba22-e7d03f3b598f]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG os_brick.utils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updating existing volume attachment record: 2e9b584d-dad1-4a78-8407-cc0d40e2143a {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:39:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:57 user nova-compute[74241]: INFO nova.compute.manager [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Terminating instance
Oct 20 11:39:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:39:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "df39a80e-8be5-4453-a0f3-866d00c27f65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-ce5d8c58-c5ac-4746-ad6f-160d65c4e039 req-c896cebd-6b30-4fba-b1ec-b5619e120f24 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received event network-vif-unplugged-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ce5d8c58-c5ac-4746-ad6f-160d65c4e039 req-c896cebd-6b30-4fba-b1ec-b5619e120f24 service nova] Acquiring lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ce5d8c58-c5ac-4746-ad6f-160d65c4e039 req-c896cebd-6b30-4fba-b1ec-b5619e120f24 service nova] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ce5d8c58-c5ac-4746-ad6f-160d65c4e039 req-c896cebd-6b30-4fba-b1ec-b5619e120f24 service nova] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-ce5d8c58-c5ac-4746-ad6f-160d65c4e039 req-c896cebd-6b30-4fba-b1ec-b5619e120f24 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] No waiting events found dispatching network-vif-unplugged-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-ce5d8c58-c5ac-4746-ad6f-160d65c4e039 req-c896cebd-6b30-4fba-b1ec-b5619e120f24 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received event network-vif-unplugged-fd103f71-ffd8-45d8-a628-558f364e80b8 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:39:58 user nova-compute[74241]: INFO nova.compute.claims [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Claim successful on node user
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Instance destroyed successfully.
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.objects.instance [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lazy-loading 'resources' on Instance uuid 2e3d3300-5e5c-4de7-8178-8342ad15a06b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1251344815',display_name='tempest-VolumesAdminNegativeTest-server-1251344815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1251344815',id=13,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:37:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42b0bf8e61964896a236f83d739a7366',ramdisk_id='',reservation_id='r-pb0zy80l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-617790048',owner_user_name='tempest-VolumesAdminNegativeTest-617790048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:38:00Z,user_data=None,user_id='555d42ae165f487a9fe068dd8b06e6cc',uuid=2e3d3300-5e5c-4de7-8178-8342ad15a06b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converting VIF {"id": "fd103f71-ffd8-45d8-a628-558f364e80b8", "address": "fa:16:3e:e3:fd:d5", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd103f71-ff", "ovs_interfaceid": "fd103f71-ffd8-45d8-a628-558f364e80b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fd:d5,bridge_name='br-int',has_traffic_filtering=True,id=fd103f71-ffd8-45d8-a628-558f364e80b8,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd103f71-ff') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG os_vif [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fd:d5,bridge_name='br-int',has_traffic_filtering=True,id=fd103f71-ffd8-45d8-a628-558f364e80b8,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd103f71-ff') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd103f71-ff, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75a3f3fa-1a80-4d0d-9bdf-0988dd7de279) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:39:58 user nova-compute[74241]: INFO os_vif [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:fd:d5,bridge_name='br-int',has_traffic_filtering=True,id=fd103f71-ffd8-45d8-a628-558f364e80b8,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd103f71-ff')
Oct 20 11:39:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Deleting instance files /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b_del
Oct 20 11:39:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Deletion of /opt/stack/data/nova/instances/2e3d3300-5e5c-4de7-8178-8342ad15a06b_del complete
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:39:58 user nova-compute[74241]: INFO nova.compute.manager [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Took 0.76 seconds to destroy the instance on the hypervisor.
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:39:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:39:58 user nova-compute[74241]: DEBUG nova.policy [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bd4a77e2a545ab888a85c2e561ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1a3993ce9641a5915b335135b32672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:39:59 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Creating image(s)
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "/opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "/opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "/opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:39:59 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Took 0.59 seconds to deallocate network for instance.
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.222s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-21d7afca-8983-4682-8329-117af761a648 req-9e2f8cd6-e3ed-4ddd-8731-298cbe8cc7ae service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received event network-vif-deleted-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:39:59 user nova-compute[74241]: INFO nova.compute.manager [req-21d7afca-8983-4682-8329-117af761a648 req-9e2f8cd6-e3ed-4ddd-8731-298cbe8cc7ae service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Neutron deleted interface fd103f71-ffd8-45d8-a628-558f364e80b8; detaching it from the instance and deleting it from the info cache
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.network.neutron [req-21d7afca-8983-4682-8329-117af761a648 req-9e2f8cd6-e3ed-4ddd-8731-298cbe8cc7ae service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-21d7afca-8983-4682-8329-117af761a648 req-9e2f8cd6-e3ed-4ddd-8731-298cbe8cc7ae service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Detach interface failed, port_id=fd103f71-ffd8-45d8-a628-558f364e80b8, reason: Instance 2e3d3300-5e5c-4de7-8178-8342ad15a06b could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.216s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk 1073741824" returned: 0 in 0.076s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Successfully created port: ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.210s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.484s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:39:59 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Deleted allocations for instance 2e3d3300-5e5c-4de7-8178-8342ad15a06b
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Cannot resize image /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Ensure instance console log exists: /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:39:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-21d97b42-b689-43b1-bdd3-c7ea6e353045 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-ed6f2388-b11b-4bda-b37c-7d4d80bc93c1 req-8b4b7ab5-f97c-4d69-b3b8-538faea2ed93 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received event network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed6f2388-b11b-4bda-b37c-7d4d80bc93c1 req-8b4b7ab5-f97c-4d69-b3b8-538faea2ed93 service nova] Acquiring lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed6f2388-b11b-4bda-b37c-7d4d80bc93c1 req-8b4b7ab5-f97c-4d69-b3b8-538faea2ed93 service nova] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed6f2388-b11b-4bda-b37c-7d4d80bc93c1 req-8b4b7ab5-f97c-4d69-b3b8-538faea2ed93 service nova] Lock "2e3d3300-5e5c-4de7-8178-8342ad15a06b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-ed6f2388-b11b-4bda-b37c-7d4d80bc93c1 req-8b4b7ab5-f97c-4d69-b3b8-538faea2ed93 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] No waiting events found dispatching network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:00 user nova-compute[74241]: WARNING nova.compute.manager [req-ed6f2388-b11b-4bda-b37c-7d4d80bc93c1 req-8b4b7ab5-f97c-4d69-b3b8-538faea2ed93 service nova] [instance: 2e3d3300-5e5c-4de7-8178-8342ad15a06b] Received unexpected event network-vif-plugged-fd103f71-ffd8-45d8-a628-558f364e80b8 for instance with vm_state deleted and task_state None.
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Successfully updated port: ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquired lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-e4c82353-6ce0-4c34-b9e0-a4fc7d8a9578 req-ab7ecf20-3907-4daa-bd17-f78028238642 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received event network-changed-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-e4c82353-6ce0-4c34-b9e0-a4fc7d8a9578 req-ab7ecf20-3907-4daa-bd17-f78028238642 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Refreshing instance network info cache due to event network-changed-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e4c82353-6ce0-4c34-b9e0-a4fc7d8a9578 req-ab7ecf20-3907-4daa-bd17-f78028238642 service nova] Acquiring lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Updating instance_info_cache with network_info: [{"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Releasing lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Instance network_info: |[{"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e4c82353-6ce0-4c34-b9e0-a4fc7d8a9578 req-ab7ecf20-3907-4daa-bd17-f78028238642 service nova] Acquired lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-e4c82353-6ce0-4c34-b9e0-a4fc7d8a9578 req-ab7ecf20-3907-4daa-bd17-f78028238642 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Refreshing network info cache for port ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Start _get_guest_xml network_info=[{"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:40:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:40:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1670218933',display_name='tempest-ServersNegativeTestJSON-server-1670218933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1670218933',id=15,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1a3993ce9641a5915b335135b32672',ramdisk_id='',reservation_id='r-dxw6x51w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-819929623',owner_user_name='tempest-ServersNegativeTestJSON-819929623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:39:59Z,user_data=None,user_id='81bd4a77e2a545ab888a85c2e561ef04',uuid=df39a80e-8be5-4453-a0f3-866d00c27f65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converting VIF {"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:76:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae87b6f8-ee') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.objects.instance [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lazy-loading 'pci_devices' on Instance uuid df39a80e-8be5-4453-a0f3-866d00c27f65 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:40:00 user nova-compute[74241]:   <uuid>df39a80e-8be5-4453-a0f3-866d00c27f65</uuid>
Oct 20 11:40:00 user nova-compute[74241]:   <name>instance-0000000f</name>
Oct 20 11:40:00 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:40:00 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:40:00 user nova-compute[74241]:   <metadata>
Oct 20 11:40:00 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:40:00 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:40:00 user nova-compute[74241]:       <nova:name>tempest-ServersNegativeTestJSON-server-1670218933</nova:name>
Oct 20 11:40:00 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:40:00</nova:creationTime>
Oct 20 11:40:00 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:40:00 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:40:00 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:40:00 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:40:00 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:40:00 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:40:00 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:40:00 user nova-compute[74241]:       <nova:owner>
Oct 20 11:40:00 user nova-compute[74241]:         <nova:user uuid="81bd4a77e2a545ab888a85c2e561ef04">tempest-ServersNegativeTestJSON-819929623-project-member</nova:user>
Oct 20 11:40:00 user nova-compute[74241]:         <nova:project uuid="3a1a3993ce9641a5915b335135b32672">tempest-ServersNegativeTestJSON-819929623</nova:project>
Oct 20 11:40:00 user nova-compute[74241]:       </nova:owner>
Oct 20 11:40:00 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:40:00 user nova-compute[74241]:       <nova:ports>
Oct 20 11:40:00 user nova-compute[74241]:         <nova:port uuid="ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778">
Oct 20 11:40:00 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 11:40:00 user nova-compute[74241]:         </nova:port>
Oct 20 11:40:00 user nova-compute[74241]:       </nova:ports>
Oct 20 11:40:00 user nova-compute[74241]:     </nova:instance>
Oct 20 11:40:00 user nova-compute[74241]:   </metadata>
Oct 20 11:40:00 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:40:00 user nova-compute[74241]:     <system>
Oct 20 11:40:00 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:40:00 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:40:00 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:40:00 user nova-compute[74241]:       <entry name="serial">df39a80e-8be5-4453-a0f3-866d00c27f65</entry>
Oct 20 11:40:00 user nova-compute[74241]:       <entry name="uuid">df39a80e-8be5-4453-a0f3-866d00c27f65</entry>
Oct 20 11:40:00 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:40:00 user nova-compute[74241]:     </system>
Oct 20 11:40:00 user nova-compute[74241]:   </sysinfo>
Oct 20 11:40:00 user nova-compute[74241]:   <os>
Oct 20 11:40:00 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:40:00 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:40:00 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:40:00 user nova-compute[74241]:   </os>
Oct 20 11:40:00 user nova-compute[74241]:   <features>
Oct 20 11:40:00 user nova-compute[74241]:     <acpi/>
Oct 20 11:40:00 user nova-compute[74241]:     <apic/>
Oct 20 11:40:00 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:40:00 user nova-compute[74241]:   </features>
Oct 20 11:40:00 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:40:00 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:40:00 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:40:00 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:40:00 user nova-compute[74241]:   </clock>
Oct 20 11:40:00 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:40:00 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:40:00 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:40:00 user nova-compute[74241]:   </cpu>
Oct 20 11:40:00 user nova-compute[74241]:   <devices>
Oct 20 11:40:00 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:40:00 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:40:00 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk"/>
Oct 20 11:40:00 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:40:00 user nova-compute[74241]:     </disk>
Oct 20 11:40:00 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:40:00 user nova-compute[74241]:       <mac address="fa:16:3e:d7:76:3f"/>
Oct 20 11:40:00 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:40:00 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:40:00 user nova-compute[74241]:       <target dev="tapae87b6f8-ee"/>
Oct 20 11:40:00 user nova-compute[74241]:     </interface>
Oct 20 11:40:00 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:40:00 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/console.log" append="off"/>
Oct 20 11:40:00 user nova-compute[74241]:     </serial>
Oct 20 11:40:00 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:40:00 user nova-compute[74241]:     <video>
Oct 20 11:40:00 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:40:00 user nova-compute[74241]:     </video>
Oct 20 11:40:00 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:40:00 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:40:00 user nova-compute[74241]:     </rng>
Oct 20 11:40:00 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:40:00 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:40:00 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:40:00 user nova-compute[74241]:     </memballoon>
Oct 20 11:40:00 user nova-compute[74241]:   </devices>
Oct 20 11:40:00 user nova-compute[74241]: </domain>
Oct 20 11:40:00 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1670218933',display_name='tempest-ServersNegativeTestJSON-server-1670218933',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1670218933',id=15,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1a3993ce9641a5915b335135b32672',ramdisk_id='',reservation_id='r-dxw6x51w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-819929623',owner_user_name='tempest-ServersNegativeTestJSON-819929623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:39:59Z,user_data=None,user_id='81bd4a77e2a545ab888a85c2e561ef04',uuid=df39a80e-8be5-4453-a0f3-866d00c27f65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converting VIF {"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:76:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae87b6f8-ee') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG os_vif [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:76:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae87b6f8-ee') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c4913aa-d0bd-5a03-a154-9632a1056e1b', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae87b6f8-ee, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae87b6f8-ee, col_values=(('qos', UUID('290088d5-2e12-4336-a83d-eb49d0d21209')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae87b6f8-ee, col_values=(('external_ids', {'iface-id': 'ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:76:3f', 'vm-uuid': 'df39a80e-8be5-4453-a0f3-866d00c27f65'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:40:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:01 user nova-compute[74241]: INFO os_vif [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:76:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae87b6f8-ee')
Oct 20 11:40:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:40:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] No VIF found with MAC fa:16:3e:d7:76:3f, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:40:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-e4c82353-6ce0-4c34-b9e0-a4fc7d8a9578 req-ab7ecf20-3907-4daa-bd17-f78028238642 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Updated VIF entry in instance network info cache for port ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:40:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-e4c82353-6ce0-4c34-b9e0-a4fc7d8a9578 req-ab7ecf20-3907-4daa-bd17-f78028238642 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Updating instance_info_cache with network_info: [{"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e4c82353-6ce0-4c34-b9e0-a4fc7d8a9578 req-ab7ecf20-3907-4daa-bd17-f78028238642 service nova] Releasing lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:40:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Creating image(s)
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.420s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.223s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk 1073741824" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.416s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.207s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-aeb036fb-4463-46b9-92cd-b656a0354a52 req-a52e0d44-e54a-41b5-8650-478b08c56db2 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received event network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aeb036fb-4463-46b9-92cd-b656a0354a52 req-a52e0d44-e54a-41b5-8650-478b08c56db2 service nova] Acquiring lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aeb036fb-4463-46b9-92cd-b656a0354a52 req-a52e0d44-e54a-41b5-8650-478b08c56db2 service nova] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aeb036fb-4463-46b9-92cd-b656a0354a52 req-a52e0d44-e54a-41b5-8650-478b08c56db2 service nova] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-aeb036fb-4463-46b9-92cd-b656a0354a52 req-a52e0d44-e54a-41b5-8650-478b08c56db2 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] No waiting events found dispatching network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:03 user nova-compute[74241]: WARNING nova.compute.manager [req-aeb036fb-4463-46b9-92cd-b656a0354a52 req-a52e0d44-e54a-41b5-8650-478b08c56db2 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received unexpected event network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 for instance with vm_state building and task_state spawning.
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Cannot resize image /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Ensure instance console log exists: /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Start _get_guest_xml network_info=[{"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '40fbb536-3d59-46cb-94fe-a7016b9e340b', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJZEtANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c19279cb-daa2-491e-8288-e0f2ce35dc1b', 'attached_at': '', 'detached_at': '', 'volume_id': 'daa4dbd3-121d-416b-8070-2e3b8616b91f', 'serial': 'daa4dbd3-121d-416b-8070-2e3b8616b91f'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:03 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 11:40:03 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 11:40:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.objects.instance [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'vcpu_model' on Instance uuid c19279cb-daa2-491e-8288-e0f2ce35dc1b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJZEtANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:40:03 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:40:03 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:40:03 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38950f5-d72e-48ea-8852-3db8a4866363]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:40:03 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e3637e-e47c-44d1-ae3e-b54b3b8c59e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f] added
Oct 20 11:40:03 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d4247d-8682-4269-ac8f-3f0e075a95b8]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd69fbe-7151-45df-88c0-70bd4f781840]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJZEtANr {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jJZEtANr" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde304ed-d277-4cf3-b144-42fa73d6960a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jJZEtANr'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b0dda-9419-4ae4-99bc-0ee4c34f2f00]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[892f3854-e21f-4dfc-97b2-40f152f3478b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:40:03 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:40:03 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:40:03 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:40:03 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ac8ec7-635a-4ac1-a882-c487d34465e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260]
Oct 20 11:40:03 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260] successful.
Oct 20 11:40:03 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b9e22a-e304-44ac-a115-1e2dac6e2bad]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[94deda5c-210c-41de-a831-d91b8be41767]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:40:03 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:40:03 user nova-compute[74241]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:03 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:40:03 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:40:03 user nova-compute[74241]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:03 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed8695e-3746-4d5d-a32e-3aff915bac1d]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:40:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJZEtANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:40:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26165396232373434', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165396232373434', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T11:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-325758242',display_name='tempest-ServerActionsTestOtherA-server-1809989271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-325758242',id=12,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfdRRJbVskDjUThR/IvsP9b1m3vihpGe7aDy8UUiNypatNlCMWiRW9yckmulY6+ixramzXREUBSZQPfWajqoa/vgaSkHTU6CP3WpmBYFOXyTjhpz8m1yETa+pNT54qdoA==',key_name='tempest-keypair-1196191213',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:37:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-a1kpnac2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=c19279cb-daa2-491e-8288-e0f2ce35dc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:40:05 user nova-compute[74241]:   <uuid>c19279cb-daa2-491e-8288-e0f2ce35dc1b</uuid>
Oct 20 11:40:05 user nova-compute[74241]:   <name>instance-0000000c</name>
Oct 20 11:40:05 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:40:05 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:40:05 user nova-compute[74241]:   <metadata>
Oct 20 11:40:05 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:40:05 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:40:05 user nova-compute[74241]:       <nova:name>tempest-ServerActionsTestOtherA-server-1809989271</nova:name>
Oct 20 11:40:05 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:40:03</nova:creationTime>
Oct 20 11:40:05 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:40:05 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:40:05 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:40:05 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:40:05 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:40:05 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:40:05 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:40:05 user nova-compute[74241]:       <nova:owner>
Oct 20 11:40:05 user nova-compute[74241]:         <nova:user uuid="3d7605635edc4cf9bddad897b8c18b77">tempest-ServerActionsTestOtherA-1364765065-project-member</nova:user>
Oct 20 11:40:05 user nova-compute[74241]:         <nova:project uuid="f4449c61c4f64b2f96f4ac79b72c8f95">tempest-ServerActionsTestOtherA-1364765065</nova:project>
Oct 20 11:40:05 user nova-compute[74241]:       </nova:owner>
Oct 20 11:40:05 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:40:05 user nova-compute[74241]:       <nova:ports>
Oct 20 11:40:05 user nova-compute[74241]:         <nova:port uuid="bca45587-745d-4a9a-82bd-17d504fa1d16">
Oct 20 11:40:05 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 11:40:05 user nova-compute[74241]:         </nova:port>
Oct 20 11:40:05 user nova-compute[74241]:       </nova:ports>
Oct 20 11:40:05 user nova-compute[74241]:     </nova:instance>
Oct 20 11:40:05 user nova-compute[74241]:   </metadata>
Oct 20 11:40:05 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:40:05 user nova-compute[74241]:     <system>
Oct 20 11:40:05 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:40:05 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:40:05 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:40:05 user nova-compute[74241]:       <entry name="serial">c19279cb-daa2-491e-8288-e0f2ce35dc1b</entry>
Oct 20 11:40:05 user nova-compute[74241]:       <entry name="uuid">c19279cb-daa2-491e-8288-e0f2ce35dc1b</entry>
Oct 20 11:40:05 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:40:05 user nova-compute[74241]:     </system>
Oct 20 11:40:05 user nova-compute[74241]:   </sysinfo>
Oct 20 11:40:05 user nova-compute[74241]:   <os>
Oct 20 11:40:05 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:40:05 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:40:05 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:40:05 user nova-compute[74241]:   </os>
Oct 20 11:40:05 user nova-compute[74241]:   <features>
Oct 20 11:40:05 user nova-compute[74241]:     <acpi/>
Oct 20 11:40:05 user nova-compute[74241]:     <apic/>
Oct 20 11:40:05 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:40:05 user nova-compute[74241]:   </features>
Oct 20 11:40:05 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:40:05 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:40:05 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:40:05 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:40:05 user nova-compute[74241]:   </clock>
Oct 20 11:40:05 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:40:05 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:40:05 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:40:05 user nova-compute[74241]:   </cpu>
Oct 20 11:40:05 user nova-compute[74241]:   <devices>
Oct 20 11:40:05 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:40:05 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:40:05 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk"/>
Oct 20 11:40:05 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:40:05 user nova-compute[74241]:     </disk>
Oct 20 11:40:05 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:40:05 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:40:05 user nova-compute[74241]:       <source dev="/dev/sdc"/>
Oct 20 11:40:05 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:40:05 user nova-compute[74241]:       <serial>daa4dbd3-121d-416b-8070-2e3b8616b91f</serial>
Oct 20 11:40:05 user nova-compute[74241]:     </disk>
Oct 20 11:40:05 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:40:05 user nova-compute[74241]:       <mac address="fa:16:3e:74:36:99"/>
Oct 20 11:40:05 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:40:05 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:40:05 user nova-compute[74241]:       <target dev="tapbca45587-74"/>
Oct 20 11:40:05 user nova-compute[74241]:     </interface>
Oct 20 11:40:05 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:40:05 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/console.log" append="off"/>
Oct 20 11:40:05 user nova-compute[74241]:     </serial>
Oct 20 11:40:05 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:40:05 user nova-compute[74241]:     <video>
Oct 20 11:40:05 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:40:05 user nova-compute[74241]:     </video>
Oct 20 11:40:05 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:40:05 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:40:05 user nova-compute[74241]:     </rng>
Oct 20 11:40:05 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:40:05 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:40:05 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:40:05 user nova-compute[74241]:     </memballoon>
Oct 20 11:40:05 user nova-compute[74241]:   </devices>
Oct 20 11:40:05 user nova-compute[74241]: </domain>
Oct 20 11:40:05 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T11:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-325758242',display_name='tempest-ServerActionsTestOtherA-server-1809989271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-325758242',id=12,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfdRRJbVskDjUThR/IvsP9b1m3vihpGe7aDy8UUiNypatNlCMWiRW9yckmulY6+ixramzXREUBSZQPfWajqoa/vgaSkHTU6CP3WpmBYFOXyTjhpz8m1yETa+pNT54qdoA==',key_name='tempest-keypair-1196191213',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:37:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-a1kpnac2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:39:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=c19279cb-daa2-491e-8288-e0f2ce35dc1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG os_vif [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d45f3da-2a73-5cfb-823a-14a154c2df7f', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbca45587-74, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbca45587-74, col_values=(('qos', UUID('5febc725-9b27-494b-bbb6-af4db4ac3c9d')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbca45587-74, col_values=(('external_ids', {'iface-id': 'bca45587-745d-4a9a-82bd-17d504fa1d16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:36:99', 'vm-uuid': 'c19279cb-daa2-491e-8288-e0f2ce35dc1b'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:05 user nova-compute[74241]: INFO os_vif [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74')
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:40:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Instance spawned successfully.
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No VIF found with MAC fa:16:3e:74:36:99, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:05 user nova-compute[74241]: INFO nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Took 6.25 seconds to spawn the instance on the hypervisor.
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:40:05 user nova-compute[74241]: INFO nova.compute.manager [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Took 7.22 seconds to build instance.
Oct 20 11:40:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-aef0cfac-1f85-437e-82de-f21c57f1822d tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.353s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-167f7f21-1c78-44c5-84e2-58a647cd38d0 req-2e1dd111-7f35-45b0-ba9f-5f9c95ff95d1 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received event network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-167f7f21-1c78-44c5-84e2-58a647cd38d0 req-2e1dd111-7f35-45b0-ba9f-5f9c95ff95d1 service nova] Acquiring lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-167f7f21-1c78-44c5-84e2-58a647cd38d0 req-2e1dd111-7f35-45b0-ba9f-5f9c95ff95d1 service nova] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-167f7f21-1c78-44c5-84e2-58a647cd38d0 req-2e1dd111-7f35-45b0-ba9f-5f9c95ff95d1 service nova] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-167f7f21-1c78-44c5-84e2-58a647cd38d0 req-2e1dd111-7f35-45b0-ba9f-5f9c95ff95d1 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] No waiting events found dispatching network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:05 user nova-compute[74241]: WARNING nova.compute.manager [req-167f7f21-1c78-44c5-84e2-58a647cd38d0 req-2e1dd111-7f35-45b0-ba9f-5f9c95ff95d1 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received unexpected event network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 for instance with vm_state active and task_state None.
Oct 20 11:40:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-c450ab29-61f7-4f2c-873a-b4bf7cecc792 req-0f6bdfc3-f753-43a7-b2f6-11d7d627b7e1 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c450ab29-61f7-4f2c-873a-b4bf7cecc792 req-0f6bdfc3-f753-43a7-b2f6-11d7d627b7e1 service nova] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c450ab29-61f7-4f2c-873a-b4bf7cecc792 req-0f6bdfc3-f753-43a7-b2f6-11d7d627b7e1 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c450ab29-61f7-4f2c-873a-b4bf7cecc792 req-0f6bdfc3-f753-43a7-b2f6-11d7d627b7e1 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-c450ab29-61f7-4f2c-873a-b4bf7cecc792 req-0f6bdfc3-f753-43a7-b2f6-11d7d627b7e1 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] No waiting events found dispatching network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:06 user nova-compute[74241]: WARNING nova.compute.manager [req-c450ab29-61f7-4f2c-873a-b4bf7cecc792 req-0f6bdfc3-f753-43a7-b2f6-11d7d627b7e1 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received unexpected event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 11:40:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:08 user nova-compute[74241]: INFO nova.compute.manager [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Terminating instance
Oct 20 11:40:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-eeac5fb0-d393-4029-8eca-609cb9f34825 req-ecf7457d-8723-498e-ba55-c890a5b121f5 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eeac5fb0-d393-4029-8eca-609cb9f34825 req-ecf7457d-8723-498e-ba55-c890a5b121f5 service nova] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eeac5fb0-d393-4029-8eca-609cb9f34825 req-ecf7457d-8723-498e-ba55-c890a5b121f5 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eeac5fb0-d393-4029-8eca-609cb9f34825 req-ecf7457d-8723-498e-ba55-c890a5b121f5 service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-eeac5fb0-d393-4029-8eca-609cb9f34825 req-ecf7457d-8723-498e-ba55-c890a5b121f5 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] No waiting events found dispatching network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:09 user nova-compute[74241]: WARNING nova.compute.manager [req-eeac5fb0-d393-4029-8eca-609cb9f34825 req-ecf7457d-8723-498e-ba55-c890a5b121f5 service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received unexpected event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:09 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance spawned successfully.
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f10f950-16f3-4cc8-9c07-c499dc57cfea req-dda5a538-eeb8-4c7d-82e1-27153438a052 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-unplugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f10f950-16f3-4cc8-9c07-c499dc57cfea req-dda5a538-eeb8-4c7d-82e1-27153438a052 service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f10f950-16f3-4cc8-9c07-c499dc57cfea req-dda5a538-eeb8-4c7d-82e1-27153438a052 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f10f950-16f3-4cc8-9c07-c499dc57cfea req-dda5a538-eeb8-4c7d-82e1-27153438a052 service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f10f950-16f3-4cc8-9c07-c499dc57cfea req-dda5a538-eeb8-4c7d-82e1-27153438a052 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] No waiting events found dispatching network-vif-unplugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f10f950-16f3-4cc8-9c07-c499dc57cfea req-dda5a538-eeb8-4c7d-82e1-27153438a052 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-unplugged-f3ee0369-7aca-4c21-8798-c9158cc47bec for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.objects.instance [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74241) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57e67a99-d488-4ac4-9dea-379123078ada tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.102s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:09 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Instance destroyed successfully.
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lazy-loading 'resources' on Instance uuid 34e3ad13-abe7-4167-9d8c-474f59397b6e {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T11:34:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1119991789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1295570451',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaUIsowPmm/MBl/9oF/rCt+woqma1ayrQNEAD67yYMwRXAZ/8sIsCOKQwamQdDx/t/+9n1SuwVQPPyBfK/H1EhTaY9NImQ0KPlZ9u0wdeUyzHwRbNbIGnoy7DD6297w1w==',key_name='tempest-keypair-1421120003',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c453ef58eb74b0d9ae83d020931ff83',ramdisk_id='',reservation_id='r-s8k6ynmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1927240912',owner_user_name='tempest-ServerActionsV293TestJSON-1927240912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:38:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfbfcb932abf47388e416266cd2f1098',uuid=34e3ad13-abe7-4167-9d8c-474f59397b6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converting VIF {"id": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "address": "fa:16:3e:68:93:2a", "network": {"id": "e68a4250-6a76-4c4c-a22f-99589a6d3ab2", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1512721676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c453ef58eb74b0d9ae83d020931ff83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3ee0369-7a", "ovs_interfaceid": "f3ee0369-7aca-4c21-8798-c9158cc47bec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_vif [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3ee0369-7a, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86037b4b-b0a4-452e-8117-f1bc23d40eee) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:40:09 user nova-compute[74241]: INFO os_vif [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:93:2a,bridge_name='br-int',has_traffic_filtering=True,id=f3ee0369-7aca-4c21-8798-c9158cc47bec,network=Network(e68a4250-6a76-4c4c-a22f-99589a6d3ab2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3ee0369-7a')
Oct 20 11:40:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RUxbdFNp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:40:09 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0e88e-e9c4-4a49-8fe4-fb82ed04ce88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:40:09 user nova-compute[74241]: No targets found.
Oct 20 11:40:09 user nova-compute[74241]: iSNS:
Oct 20 11:40:09 user nova-compute[74241]: No targets found.
Oct 20 11:40:09 user nova-compute[74241]: STATIC:
Oct 20 11:40:09 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b
Oct 20 11:40:09 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:40:09 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:40:09 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f
Oct 20 11:40:09 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:40:09 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:40:09 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:40:09 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:40:09 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:40:09 user nova-compute[74241]: FIRMWARE:
Oct 20 11:40:09 user nova-compute[74241]: No targets found.
Oct 20 11:40:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:40:09 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:40:09 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[523b5981-9613-40c0-b692-9c81a86ea5fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab92640-2e30-4e6d-9e6d-dd125aac1cd5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:40:09 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:40:09 user nova-compute[74241]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:40:09 user nova-compute[74241]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b (non-flash)
Oct 20 11:40:09 user nova-compute[74241]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52086840d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[651eea77-d206-467f-98b1-06b8552f58b8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d98a81-98d2-4f06-82b7-518d043bf13f]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e30a25-aa3b-4ab8-95a7-5b612b3e1b10]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:40:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b889be03-5562-4afd-bfaf-f36a3d81067a]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1e277de', '/dev/disk/by-id/scsi-1SCST_BIOa1e277de-aac28a3398140e9b', '/dev/disk/by-id/scsi-26161633238613333') {{(pid=85185) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2539e003-5106-4cf1-888c-178e71044bcc]: (4, None) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[757fb08e-d7c2-4b2e-82b1-2b7674b5f918]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a394535-3a34-477b-b5a8-a7572927c5a7]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260]
Oct 20 11:40:10 user nova-compute[74241]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b, portal: 172.16.0.220,3260] successful.
Oct 20 11:40:10 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2238763d-1ef0-47ab-8b4d-426b0d0d935b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd547526-20c3-4b7e-9851-5eca7d0ab9a0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] <== disconnect_volume: return (390ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:40:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Deleting instance files /opt/stack/data/nova/instances/34e3ad13-abe7-4167-9d8c-474f59397b6e_del
Oct 20 11:40:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Deletion of /opt/stack/data/nova/instances/34e3ad13-abe7-4167-9d8c-474f59397b6e_del complete
Oct 20 11:40:10 user nova-compute[74241]: INFO nova.compute.manager [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Took 1.37 seconds to destroy the instance on the hypervisor.
Oct 20 11:40:10 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:40:10 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:40:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-b6a04059-bd3a-4d7b-ac96-5ca5f7b6c934 req-a058a36e-29f0-4b8a-adbe-fbea58b57c9c service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b6a04059-bd3a-4d7b-ac96-5ca5f7b6c934 req-a058a36e-29f0-4b8a-adbe-fbea58b57c9c service nova] Acquiring lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b6a04059-bd3a-4d7b-ac96-5ca5f7b6c934 req-a058a36e-29f0-4b8a-adbe-fbea58b57c9c service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b6a04059-bd3a-4d7b-ac96-5ca5f7b6c934 req-a058a36e-29f0-4b8a-adbe-fbea58b57c9c service nova] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-b6a04059-bd3a-4d7b-ac96-5ca5f7b6c934 req-a058a36e-29f0-4b8a-adbe-fbea58b57c9c service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] No waiting events found dispatching network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:11 user nova-compute[74241]: WARNING nova.compute.manager [req-b6a04059-bd3a-4d7b-ac96-5ca5f7b6c934 req-a058a36e-29f0-4b8a-adbe-fbea58b57c9c service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received unexpected event network-vif-plugged-f3ee0369-7aca-4c21-8798-c9158cc47bec for instance with vm_state active and task_state deleting.
Oct 20 11:40:11 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:11 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Took 1.28 seconds to deallocate network for instance.
Oct 20 11:40:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-28197688-dfad-4ffe-bef2-2cc8fbd18e1c req-e968e6cb-f822-49da-a09d-5b1807a12755 service nova] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Received event network-vif-deleted-f3ee0369-7aca-4c21-8798-c9158cc47bec {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:12 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a is timed out.
Oct 20 11:40:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Successfully detached device vdb from instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a from the live domain config.
Oct 20 11:40:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BnCSkuNm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:40:12 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c5edab-12d9-4dd1-b195-6a278715c1e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:40:12 user nova-compute[74241]: No targets found.
Oct 20 11:40:12 user nova-compute[74241]: iSNS:
Oct 20 11:40:12 user nova-compute[74241]: No targets found.
Oct 20 11:40:12 user nova-compute[74241]: STATIC:
Oct 20 11:40:12 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f
Oct 20 11:40:12 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:40:12 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:40:12 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6
Oct 20 11:40:12 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:40:12 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:40:12 user nova-compute[74241]: FIRMWARE:
Oct 20 11:40:12 user nova-compute[74241]: No targets found.
Oct 20 11:40:12 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:40:12 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:40:12 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4552a85b-1145-4bf1-beff-a8f27ba9a36d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:12 user nova-compute[74241]: INFO nova.compute.manager [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Took 1.15 seconds to detach 1 volumes for instance.
Oct 20 11:40:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] [instance: 34e3ad13-abe7-4167-9d8c-474f59397b6e] Deleting volume: 2238763d-1ef0-47ab-8b4d-426b0d0d935b {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2fa893-3a5d-4bdc-9eb3-67cb8f387579]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:40:12 user nova-compute[74241]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:12 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 (non-flash)
Oct 20 11:40:12 user nova-compute[74241]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:12 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52086c1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6'): ({'sdd'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Removing single pathed devices sdd {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5d9cfe-8bdb-4005-ae92-6ed06db915d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4995ae2-81a0-492a-b64c-3b477df04a2a]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Flushing IO for device /dev/sdd {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d30085b-dead-4241-afbc-a5982333e017]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af6f51f-d067-4436-9e13-cb67492141b1]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cac80a5-bb33-421d-a839-0f5e5ab68483]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a09f15-06a8-4cab-878d-3f6c5231839a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6, portal: 172.16.0.220,3260]
Oct 20 11:40:13 user nova-compute[74241]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6, portal: 172.16.0.220,3260] successful.
Oct 20 11:40:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55d0f928-afff-41a0-b970-021ed8f154b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a62676-232b-42e9-81d8-a52a980d30c0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.496s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] <== disconnect_volume: return (497ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:40:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:13 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Deleted allocations for instance 34e3ad13-abe7-4167-9d8c-474f59397b6e
Oct 20 11:40:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a474df24-4d4c-415d-ab66-95beb19834b3 tempest-ServerActionsV293TestJSON-1927240912 tempest-ServerActionsV293TestJSON-1927240912-project-member] Lock "34e3ad13-abe7-4167-9d8c-474f59397b6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.463s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'flavor' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0862aac8-ef9f-4d3f-9c94-9c1849e5cfae tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.846s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODXNyAYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:40:14 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:40:14 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:40:14 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5028bf4f-e5ed-48cf-890f-b3991fe5b27a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:40:14 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbdd05b-6765-4765-a787-33335b9f17e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07] added
Oct 20 11:40:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dac75f-3887-4004-97ce-8a3c57fd69da]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef651e8-2da7-4b96-8b08-618dba31b150]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODXNyAYr {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODXNyAYr" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdebfa6-2e6b-459b-b685-147c8667ec89]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ODXNyAYr'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be65328-297a-4b1a-9002-a33a92803381]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafa02f2-1701-4e8c-9786-4a1a84817203]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee02cd4-db50-47a2-b08b-4e1872c0d542]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07, portal: 172.16.0.220,3260]
Oct 20 11:40:14 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07, portal: 172.16.0.220,3260] successful.
Oct 20 11:40:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bc0585-8ed5-4c55-8466-614a8d018d43]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eea5ccb-8099-47fd-a7cf-9f03daf0ce9d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:14 user nova-compute[74241]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)
Oct 20 11:40:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:40:14 user nova-compute[74241]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)
Oct 20 11:40:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[09195840-7b03-4267-9a29-86b2976b75db]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:40:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODXNyAYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:40:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:40:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26131363731613533', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:40:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131363731613533', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:40:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 217655bc-d22a-4c39-9522-29f189a6bb5f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:40:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:40:15 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:40:15 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:40:15 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:40:15 user nova-compute[74241]:   <serial>cbb88370-8b6c-4dea-97a1-53745fb93e07</serial>
Oct 20 11:40:15 user nova-compute[74241]: </disk>
Oct 20 11:40:15 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:40:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:40:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:40:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No VIF found with MAC fa:16:3e:f4:ad:64, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:40:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-edb4c36f-64de-4000-8054-4bed9058ad9c tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.020s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "067921cd-6e00-4c59-ba59-9cdd613687cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:40:21 user nova-compute[74241]: INFO nova.compute.claims [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Claim successful on node user
Oct 20 11:40:21 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.602s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:40:21 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:40:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:40:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG nova.policy [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3637bc89e77c475ba2fc72002d61b5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce95d8752f04f25a15f0673b063d405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:40:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Creating image(s)
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "/opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "/opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "/opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.268s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk 1073741824" returned: 0 in 0.069s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.244s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Successfully created port: 980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Cannot resize image /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Ensure instance console log exists: /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Successfully updated port: 980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquired lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:40:23 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-93d12fdd-e449-438e-ab16-5b5bb5bb3904 req-9b02a68a-4857-47c8-815b-b7e07d24a37e service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received event network-changed-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-93d12fdd-e449-438e-ab16-5b5bb5bb3904 req-9b02a68a-4857-47c8-815b-b7e07d24a37e service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Refreshing instance network info cache due to event network-changed-980b963e-d9c0-43ce-b742-b40edfdd7b09. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93d12fdd-e449-438e-ab16-5b5bb5bb3904 req-9b02a68a-4857-47c8-815b-b7e07d24a37e service nova] Acquiring lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Updating instance_info_cache with network_info: [{"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Releasing lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Instance network_info: |[{"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93d12fdd-e449-438e-ab16-5b5bb5bb3904 req-9b02a68a-4857-47c8-815b-b7e07d24a37e service nova] Acquired lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.neutron [req-93d12fdd-e449-438e-ab16-5b5bb5bb3904 req-9b02a68a-4857-47c8-815b-b7e07d24a37e service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Refreshing network info cache for port 980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Start _get_guest_xml network_info=[{"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:40:24 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:40:24 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1902077207',display_name='tempest-AttachVolumeNegativeTest-server-1902077207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1902077207',id=16,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkP56q2PPSoK0iBQYvQC8g7fhR2TIY6xz6oQXwUMZMvKWegjRMhavrmAWoNRUWEOtkv1dpGrN64EAMi/mahHezoYI0uEEw4r111/TlOXAr09MxAETG/nY3fPWeWK+5mKA==',key_name='tempest-keypair-936270826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-d7nn5dnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:40:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=067921cd-6e00-4c59-ba59-9cdd613687cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:bd:c7,bridge_name='br-int',has_traffic_filtering=True,id=980b963e-d9c0-43ce-b742-b40edfdd7b09,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980b963e-d9') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'pci_devices' on Instance uuid 067921cd-6e00-4c59-ba59-9cdd613687cf {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:40:24 user nova-compute[74241]:   <uuid>067921cd-6e00-4c59-ba59-9cdd613687cf</uuid>
Oct 20 11:40:24 user nova-compute[74241]:   <name>instance-00000010</name>
Oct 20 11:40:24 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:40:24 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:40:24 user nova-compute[74241]:   <metadata>
Oct 20 11:40:24 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:40:24 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:40:24 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1902077207</nova:name>
Oct 20 11:40:24 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:40:24</nova:creationTime>
Oct 20 11:40:24 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:40:24 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:40:24 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:40:24 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:40:24 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:40:24 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:40:24 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:40:24 user nova-compute[74241]:       <nova:owner>
Oct 20 11:40:24 user nova-compute[74241]:         <nova:user uuid="3637bc89e77c475ba2fc72002d61b5c2">tempest-AttachVolumeNegativeTest-252317716-project-member</nova:user>
Oct 20 11:40:24 user nova-compute[74241]:         <nova:project uuid="4ce95d8752f04f25a15f0673b063d405">tempest-AttachVolumeNegativeTest-252317716</nova:project>
Oct 20 11:40:24 user nova-compute[74241]:       </nova:owner>
Oct 20 11:40:24 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:40:24 user nova-compute[74241]:       <nova:ports>
Oct 20 11:40:24 user nova-compute[74241]:         <nova:port uuid="980b963e-d9c0-43ce-b742-b40edfdd7b09">
Oct 20 11:40:24 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 11:40:24 user nova-compute[74241]:         </nova:port>
Oct 20 11:40:24 user nova-compute[74241]:       </nova:ports>
Oct 20 11:40:24 user nova-compute[74241]:     </nova:instance>
Oct 20 11:40:24 user nova-compute[74241]:   </metadata>
Oct 20 11:40:24 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:40:24 user nova-compute[74241]:     <system>
Oct 20 11:40:24 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:40:24 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:40:24 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:40:24 user nova-compute[74241]:       <entry name="serial">067921cd-6e00-4c59-ba59-9cdd613687cf</entry>
Oct 20 11:40:24 user nova-compute[74241]:       <entry name="uuid">067921cd-6e00-4c59-ba59-9cdd613687cf</entry>
Oct 20 11:40:24 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:40:24 user nova-compute[74241]:     </system>
Oct 20 11:40:24 user nova-compute[74241]:   </sysinfo>
Oct 20 11:40:24 user nova-compute[74241]:   <os>
Oct 20 11:40:24 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:40:24 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:40:24 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:40:24 user nova-compute[74241]:   </os>
Oct 20 11:40:24 user nova-compute[74241]:   <features>
Oct 20 11:40:24 user nova-compute[74241]:     <acpi/>
Oct 20 11:40:24 user nova-compute[74241]:     <apic/>
Oct 20 11:40:24 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:40:24 user nova-compute[74241]:   </features>
Oct 20 11:40:24 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:40:24 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:40:24 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:40:24 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:40:24 user nova-compute[74241]:   </clock>
Oct 20 11:40:24 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:40:24 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:40:24 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:40:24 user nova-compute[74241]:   </cpu>
Oct 20 11:40:24 user nova-compute[74241]:   <devices>
Oct 20 11:40:24 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:40:24 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:40:24 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk"/>
Oct 20 11:40:24 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:40:24 user nova-compute[74241]:     </disk>
Oct 20 11:40:24 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:40:24 user nova-compute[74241]:       <mac address="fa:16:3e:d7:bd:c7"/>
Oct 20 11:40:24 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:40:24 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:40:24 user nova-compute[74241]:       <target dev="tap980b963e-d9"/>
Oct 20 11:40:24 user nova-compute[74241]:     </interface>
Oct 20 11:40:24 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:40:24 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/console.log" append="off"/>
Oct 20 11:40:24 user nova-compute[74241]:     </serial>
Oct 20 11:40:24 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:40:24 user nova-compute[74241]:     <video>
Oct 20 11:40:24 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:40:24 user nova-compute[74241]:     </video>
Oct 20 11:40:24 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:40:24 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:40:24 user nova-compute[74241]:     </rng>
Oct 20 11:40:24 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:40:24 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:40:24 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:40:24 user nova-compute[74241]:     </memballoon>
Oct 20 11:40:24 user nova-compute[74241]:   </devices>
Oct 20 11:40:24 user nova-compute[74241]: </domain>
Oct 20 11:40:24 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1902077207',display_name='tempest-AttachVolumeNegativeTest-server-1902077207',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1902077207',id=16,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkP56q2PPSoK0iBQYvQC8g7fhR2TIY6xz6oQXwUMZMvKWegjRMhavrmAWoNRUWEOtkv1dpGrN64EAMi/mahHezoYI0uEEw4r111/TlOXAr09MxAETG/nY3fPWeWK+5mKA==',key_name='tempest-keypair-936270826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-d7nn5dnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:40:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=067921cd-6e00-4c59-ba59-9cdd613687cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:bd:c7,bridge_name='br-int',has_traffic_filtering=True,id=980b963e-d9c0-43ce-b742-b40edfdd7b09,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980b963e-d9') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG os_vif [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:bd:c7,bridge_name='br-int',has_traffic_filtering=True,id=980b963e-d9c0-43ce-b742-b40edfdd7b09,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980b963e-d9') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c51eee7b-5694-544a-988f-30b6064611e6', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap980b963e-d9, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap980b963e-d9, col_values=(('qos', UUID('f2e7adc7-d7b9-4df2-bcae-625eb1f84426')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap980b963e-d9, col_values=(('external_ids', {'iface-id': '980b963e-d9c0-43ce-b742-b40edfdd7b09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:bd:c7', 'vm-uuid': '067921cd-6e00-4c59-ba59-9cdd613687cf'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:24 user nova-compute[74241]: INFO os_vif [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:bd:c7,bridge_name='br-int',has_traffic_filtering=True,id=980b963e-d9c0-43ce-b742-b40edfdd7b09,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980b963e-d9')
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No VIF found with MAC fa:16:3e:d7:bd:c7, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.neutron [req-93d12fdd-e449-438e-ab16-5b5bb5bb3904 req-9b02a68a-4857-47c8-815b-b7e07d24a37e service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Updated VIF entry in instance network info cache for port 980b963e-d9c0-43ce-b742-b40edfdd7b09. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG nova.network.neutron [req-93d12fdd-e449-438e-ab16-5b5bb5bb3904 req-9b02a68a-4857-47c8-815b-b7e07d24a37e service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Updating instance_info_cache with network_info: [{"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93d12fdd-e449-438e-ab16-5b5bb5bb3904 req-9b02a68a-4857-47c8-815b-b7e07d24a37e service nova] Releasing lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:40:25 user nova-compute[74241]: INFO nova.compute.claims [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Claim successful on node user
Oct 20 11:40:25 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:40:26 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.policy [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0195b190e68a42be9877144bfe0cb277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8956d1d704f54819b417cd6e5c7abd27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:40:26 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Creating image(s)
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.217s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-10538f34-809c-46e2-bb5f-38fb5e2382c5 req-1a3bfcae-ebcc-4f55-abf3-9878d22440b2 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received event network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-10538f34-809c-46e2-bb5f-38fb5e2382c5 req-1a3bfcae-ebcc-4f55-abf3-9878d22440b2 service nova] Acquiring lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-10538f34-809c-46e2-bb5f-38fb5e2382c5 req-1a3bfcae-ebcc-4f55-abf3-9878d22440b2 service nova] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-10538f34-809c-46e2-bb5f-38fb5e2382c5 req-1a3bfcae-ebcc-4f55-abf3-9878d22440b2 service nova] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-10538f34-809c-46e2-bb5f-38fb5e2382c5 req-1a3bfcae-ebcc-4f55-abf3-9878d22440b2 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] No waiting events found dispatching network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:26 user nova-compute[74241]: WARNING nova.compute.manager [req-10538f34-809c-46e2-bb5f-38fb5e2382c5 req-1a3bfcae-ebcc-4f55-abf3-9878d22440b2 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received unexpected event network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 for instance with vm_state building and task_state spawning.
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.201s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk 1073741824" returned: 0 in 0.062s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.219s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:40:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Cannot resize image /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Ensure instance console log exists: /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:27 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Successfully created port: 057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-11148f61-177c-4e47-8a65-debbf00a0bf9 req-863176e9-00b9-4ecc-8ed5-05ddb1ac5fa5 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received event network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-11148f61-177c-4e47-8a65-debbf00a0bf9 req-863176e9-00b9-4ecc-8ed5-05ddb1ac5fa5 service nova] Acquiring lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-11148f61-177c-4e47-8a65-debbf00a0bf9 req-863176e9-00b9-4ecc-8ed5-05ddb1ac5fa5 service nova] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-11148f61-177c-4e47-8a65-debbf00a0bf9 req-863176e9-00b9-4ecc-8ed5-05ddb1ac5fa5 service nova] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-11148f61-177c-4e47-8a65-debbf00a0bf9 req-863176e9-00b9-4ecc-8ed5-05ddb1ac5fa5 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] No waiting events found dispatching network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:28 user nova-compute[74241]: WARNING nova.compute.manager [req-11148f61-177c-4e47-8a65-debbf00a0bf9 req-863176e9-00b9-4ecc-8ed5-05ddb1ac5fa5 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received unexpected event network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 for instance with vm_state building and task_state spawning.
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Successfully updated port: 057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquired lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:40:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Instance spawned successfully.
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:40:28 user nova-compute[74241]: INFO nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Took 6.71 seconds to spawn the instance on the hypervisor.
Oct 20 11:40:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:29 user nova-compute[74241]: INFO nova.compute.manager [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Took 7.91 seconds to build instance.
Oct 20 11:40:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Releasing lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance network_info: |[{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Start _get_guest_xml network_info=[{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4a26d003-d152-4893-b7ce-57036285ab04 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.472s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:29 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:40:29 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lazy-loading 'pci_devices' on Instance uuid 5600826e-10a2-4079-bb18-a652aa279f45 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:40:29 user nova-compute[74241]:   <uuid>5600826e-10a2-4079-bb18-a652aa279f45</uuid>
Oct 20 11:40:29 user nova-compute[74241]:   <name>instance-00000011</name>
Oct 20 11:40:29 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:40:29 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:40:29 user nova-compute[74241]:   <metadata>
Oct 20 11:40:29 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:40:29 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:40:29 user nova-compute[74241]:       <nova:name>tempest-ServerActionsTestOtherB-server-1518638015</nova:name>
Oct 20 11:40:29 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:40:29</nova:creationTime>
Oct 20 11:40:29 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:40:29 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:40:29 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:40:29 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:40:29 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:40:29 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:40:29 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:40:29 user nova-compute[74241]:       <nova:owner>
Oct 20 11:40:29 user nova-compute[74241]:         <nova:user uuid="0195b190e68a42be9877144bfe0cb277">tempest-ServerActionsTestOtherB-805994491-project-member</nova:user>
Oct 20 11:40:29 user nova-compute[74241]:         <nova:project uuid="8956d1d704f54819b417cd6e5c7abd27">tempest-ServerActionsTestOtherB-805994491</nova:project>
Oct 20 11:40:29 user nova-compute[74241]:       </nova:owner>
Oct 20 11:40:29 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:40:29 user nova-compute[74241]:       <nova:ports>
Oct 20 11:40:29 user nova-compute[74241]:         <nova:port uuid="057c0964-5838-4c58-84aa-e479c46f8835">
Oct 20 11:40:29 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 11:40:29 user nova-compute[74241]:         </nova:port>
Oct 20 11:40:29 user nova-compute[74241]:       </nova:ports>
Oct 20 11:40:29 user nova-compute[74241]:     </nova:instance>
Oct 20 11:40:29 user nova-compute[74241]:   </metadata>
Oct 20 11:40:29 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:40:29 user nova-compute[74241]:     <system>
Oct 20 11:40:29 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:40:29 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:40:29 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:40:29 user nova-compute[74241]:       <entry name="serial">5600826e-10a2-4079-bb18-a652aa279f45</entry>
Oct 20 11:40:29 user nova-compute[74241]:       <entry name="uuid">5600826e-10a2-4079-bb18-a652aa279f45</entry>
Oct 20 11:40:29 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:40:29 user nova-compute[74241]:     </system>
Oct 20 11:40:29 user nova-compute[74241]:   </sysinfo>
Oct 20 11:40:29 user nova-compute[74241]:   <os>
Oct 20 11:40:29 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:40:29 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:40:29 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:40:29 user nova-compute[74241]:   </os>
Oct 20 11:40:29 user nova-compute[74241]:   <features>
Oct 20 11:40:29 user nova-compute[74241]:     <acpi/>
Oct 20 11:40:29 user nova-compute[74241]:     <apic/>
Oct 20 11:40:29 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:40:29 user nova-compute[74241]:   </features>
Oct 20 11:40:29 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:40:29 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:40:29 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:40:29 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:40:29 user nova-compute[74241]:   </clock>
Oct 20 11:40:29 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:40:29 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:40:29 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:40:29 user nova-compute[74241]:   </cpu>
Oct 20 11:40:29 user nova-compute[74241]:   <devices>
Oct 20 11:40:29 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:40:29 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:40:29 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk"/>
Oct 20 11:40:29 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:40:29 user nova-compute[74241]:     </disk>
Oct 20 11:40:29 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:40:29 user nova-compute[74241]:       <mac address="fa:16:3e:64:d9:51"/>
Oct 20 11:40:29 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:40:29 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:40:29 user nova-compute[74241]:       <target dev="tap057c0964-58"/>
Oct 20 11:40:29 user nova-compute[74241]:     </interface>
Oct 20 11:40:29 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:40:29 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/console.log" append="off"/>
Oct 20 11:40:29 user nova-compute[74241]:     </serial>
Oct 20 11:40:29 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:40:29 user nova-compute[74241]:     <video>
Oct 20 11:40:29 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:40:29 user nova-compute[74241]:     </video>
Oct 20 11:40:29 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:40:29 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:40:29 user nova-compute[74241]:     </rng>
Oct 20 11:40:29 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:40:29 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:40:29 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:40:29 user nova-compute[74241]:     </memballoon>
Oct 20 11:40:29 user nova-compute[74241]:   </devices>
Oct 20 11:40:29 user nova-compute[74241]: </domain>
Oct 20 11:40:29 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:40:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG os_vif [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2731e578-58fd-5bfc-b530-43668eb2a4c3', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap057c0964-58, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap057c0964-58, col_values=(('qos', UUID('dec757e6-990b-465a-9d7e-5afcd0a4c56e')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap057c0964-58, col_values=(('external_ids', {'iface-id': '057c0964-5838-4c58-84aa-e479c46f8835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:d9:51', 'vm-uuid': '5600826e-10a2-4079-bb18-a652aa279f45'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:29 user nova-compute[74241]: INFO os_vif [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58')
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:40:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] No VIF found with MAC fa:16:3e:64:d9:51, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:40:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-8a60c4fd-159d-4b00-88a7-866fe1bb448e req-6f752baf-2e76-431b-9dfc-96f9817fb32a service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-changed-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-8a60c4fd-159d-4b00-88a7-866fe1bb448e req-6f752baf-2e76-431b-9dfc-96f9817fb32a service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Refreshing instance network info cache due to event network-changed-057c0964-5838-4c58-84aa-e479c46f8835. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:40:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8a60c4fd-159d-4b00-88a7-866fe1bb448e req-6f752baf-2e76-431b-9dfc-96f9817fb32a service nova] Acquiring lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:40:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8a60c4fd-159d-4b00-88a7-866fe1bb448e req-6f752baf-2e76-431b-9dfc-96f9817fb32a service nova] Acquired lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:40:30 user nova-compute[74241]: DEBUG nova.network.neutron [req-8a60c4fd-159d-4b00-88a7-866fe1bb448e req-6f752baf-2e76-431b-9dfc-96f9817fb32a service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Refreshing network info cache for port 057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-8a60c4fd-159d-4b00-88a7-866fe1bb448e req-6f752baf-2e76-431b-9dfc-96f9817fb32a service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updated VIF entry in instance network info cache for port 057c0964-5838-4c58-84aa-e479c46f8835. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-8a60c4fd-159d-4b00-88a7-866fe1bb448e req-6f752baf-2e76-431b-9dfc-96f9817fb32a service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8a60c4fd-159d-4b00-88a7-866fe1bb448e req-6f752baf-2e76-431b-9dfc-96f9817fb32a service nova] Releasing lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-6a03fc32-7018-4f15-bf3a-c6b037d4297f req-d9547d15-83c5-411d-9cbd-e9cb3bf81e30 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6a03fc32-7018-4f15-bf3a-c6b037d4297f req-d9547d15-83c5-411d-9cbd-e9cb3bf81e30 service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6a03fc32-7018-4f15-bf3a-c6b037d4297f req-d9547d15-83c5-411d-9cbd-e9cb3bf81e30 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6a03fc32-7018-4f15-bf3a-c6b037d4297f req-d9547d15-83c5-411d-9cbd-e9cb3bf81e30 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-6a03fc32-7018-4f15-bf3a-c6b037d4297f req-d9547d15-83c5-411d-9cbd-e9cb3bf81e30 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:31 user nova-compute[74241]: WARNING nova.compute.manager [req-6a03fc32-7018-4f15-bf3a-c6b037d4297f req-d9547d15-83c5-411d-9cbd-e9cb3bf81e30 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state building and task_state spawning.
Oct 20 11:40:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-b287c635-134b-4fd7-8c1d-8e99d9ac13fd req-f2e6ee69-6b8b-448c-9bed-b792c4e86629 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b287c635-134b-4fd7-8c1d-8e99d9ac13fd req-f2e6ee69-6b8b-448c-9bed-b792c4e86629 service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b287c635-134b-4fd7-8c1d-8e99d9ac13fd req-f2e6ee69-6b8b-448c-9bed-b792c4e86629 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b287c635-134b-4fd7-8c1d-8e99d9ac13fd req-f2e6ee69-6b8b-448c-9bed-b792c4e86629 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-b287c635-134b-4fd7-8c1d-8e99d9ac13fd req-f2e6ee69-6b8b-448c-9bed-b792c4e86629 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:33 user nova-compute[74241]: WARNING nova.compute.manager [req-b287c635-134b-4fd7-8c1d-8e99d9ac13fd req-f2e6ee69-6b8b-448c-9bed-b792c4e86629 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state building and task_state spawning.
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:40:33 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance spawned successfully.
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:40:34 user nova-compute[74241]: INFO nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Took 7.86 seconds to spawn the instance on the hypervisor.
Oct 20 11:40:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:40:34 user nova-compute[74241]: INFO nova.compute.manager [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Took 8.82 seconds to build instance.
Oct 20 11:40:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2038608d-28ab-46c2-b774-9de693e8bf17 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.957s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:41 user nova-compute[74241]: INFO nova.compute.manager [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Terminating instance
Oct 20 11:40:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-8022babc-458d-47a9-afe8-e730f8dc248d req-b84dedda-25e2-48d7-8cec-cab88d70255b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8022babc-458d-47a9-afe8-e730f8dc248d req-b84dedda-25e2-48d7-8cec-cab88d70255b service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8022babc-458d-47a9-afe8-e730f8dc248d req-b84dedda-25e2-48d7-8cec-cab88d70255b service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8022babc-458d-47a9-afe8-e730f8dc248d req-b84dedda-25e2-48d7-8cec-cab88d70255b service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-8022babc-458d-47a9-afe8-e730f8dc248d req-b84dedda-25e2-48d7-8cec-cab88d70255b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-8022babc-458d-47a9-afe8-e730f8dc248d req-b84dedda-25e2-48d7-8cec-cab88d70255b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-unplugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Instance destroyed successfully.
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.objects.instance [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lazy-loading 'resources' on Instance uuid 95bf8c4c-21a0-462c-a370-eedd74d6fc1a {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-219899213',display_name='tempest-ServerStableDeviceRescueTest-server-219899213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-219899213',id=2,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/8WymVPDZxC9KfamWkU3H/nL3X9qJvU0cXONDpPlPtSbxrjqFJcKqA3LzbbDd//Q5fsnFeST6x7AHiBg7Md+G2s/LPWp5PU8eojSD2lO8Rz/5kZbTFOa0zvXzgC4RVLQ==',key_name='tempest-keypair-1870905534',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:37:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='948a6489aae6437cbcfbcd73857caa81',ramdisk_id='',reservation_id='r-z37qlkwv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-89486859',owner_user_name='tempest-ServerStableDeviceRescueTest-89486859-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43687383ff994fc5bea21a588209bf30',uuid=95bf8c4c-21a0-462c-a370-eedd74d6fc1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Converting VIF {"id": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "address": "fa:16:3e:00:c5:3e", "network": {"id": "c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-637199580-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "948a6489aae6437cbcfbcd73857caa81", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08303d9d-06", "ovs_interfaceid": "08303d9d-06cf-4e8a-a348-f1475340cb3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=08303d9d-06cf-4e8a-a348-f1475340cb3c,network=Network(c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08303d9d-06') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG os_vif [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=08303d9d-06cf-4e8a-a348-f1475340cb3c,network=Network(c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08303d9d-06') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08303d9d-06, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b350750-3fb2-40ea-9628-ec30b59d2ca7) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:42 user nova-compute[74241]: INFO os_vif [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:c5:3e,bridge_name='br-int',has_traffic_filtering=True,id=08303d9d-06cf-4e8a-a348-f1475340cb3c,network=Network(c276b9f7-a7cb-4a08-a0c4-aa52f51e5cd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08303d9d-06')
Oct 20 11:40:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Deleting instance files /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a_del
Oct 20 11:40:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Deletion of /opt/stack/data/nova/instances/95bf8c4c-21a0-462c-a370-eedd74d6fc1a_del complete
Oct 20 11:40:42 user nova-compute[74241]: INFO nova.compute.manager [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 11:40:42 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:40:42 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:40:43 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:43 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Took 1.12 seconds to deallocate network for instance.
Oct 20 11:40:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-e02dca0b-a227-4902-a276-596ee97d8855 req-f695fcb4-3c06-41bf-be27-c96913a69838 service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-deleted-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:44 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Deleted allocations for instance 95bf8c4c-21a0-462c-a370-eedd74d6fc1a
Oct 20 11:40:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-26659254-3da4-4da0-9c55-8846c2ad14e1 req-8fdb7bcb-3632-4516-9805-b29a021fb57b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-26659254-3da4-4da0-9c55-8846c2ad14e1 req-8fdb7bcb-3632-4516-9805-b29a021fb57b service nova] Acquiring lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-26659254-3da4-4da0-9c55-8846c2ad14e1 req-8fdb7bcb-3632-4516-9805-b29a021fb57b service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-26659254-3da4-4da0-9c55-8846c2ad14e1 req-8fdb7bcb-3632-4516-9805-b29a021fb57b service nova] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-26659254-3da4-4da0-9c55-8846c2ad14e1 req-8fdb7bcb-3632-4516-9805-b29a021fb57b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] No waiting events found dispatching network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:44 user nova-compute[74241]: WARNING nova.compute.manager [req-26659254-3da4-4da0-9c55-8846c2ad14e1 req-8fdb7bcb-3632-4516-9805-b29a021fb57b service nova] [instance: 95bf8c4c-21a0-462c-a370-eedd74d6fc1a] Received unexpected event network-vif-plugged-08303d9d-06cf-4e8a-a348-f1475340cb3c for instance with vm_state deleted and task_state None.
Oct 20 11:40:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-02353343-4897-49fb-a10f-7c5fb3c213fc tempest-ServerStableDeviceRescueTest-89486859 tempest-ServerStableDeviceRescueTest-89486859-project-member] Lock "95bf8c4c-21a0-462c-a370-eedd74d6fc1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.562s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:40:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:40:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:53 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:40:53 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7758MB free_disk=25.54871368408203GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance c19279cb-daa2-491e-8288-e0f2ce35dc1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 217655bc-d22a-4c39-9522-29f189a6bb5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 067921cd-6e00-4c59-ba59-9cdd613687cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5600826e-10a2-4079-bb18-a652aa279f45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:40:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.400s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:40:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:40:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:40:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:40:55 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:40:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:40:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:40:55 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:55 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:55 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:40:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:40:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:59 user nova-compute[74241]: INFO nova.compute.manager [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Terminating instance
Oct 20 11:40:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-7be114f8-efd3-46f5-8989-74242a273c64 req-c7810360-22ae-4ce1-b1c5-615deccaede2 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received event network-vif-unplugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7be114f8-efd3-46f5-8989-74242a273c64 req-c7810360-22ae-4ce1-b1c5-615deccaede2 service nova] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7be114f8-efd3-46f5-8989-74242a273c64 req-c7810360-22ae-4ce1-b1c5-615deccaede2 service nova] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7be114f8-efd3-46f5-8989-74242a273c64 req-c7810360-22ae-4ce1-b1c5-615deccaede2 service nova] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-7be114f8-efd3-46f5-8989-74242a273c64 req-c7810360-22ae-4ce1-b1c5-615deccaede2 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] No waiting events found dispatching network-vif-unplugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:40:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-7be114f8-efd3-46f5-8989-74242a273c64 req-c7810360-22ae-4ce1-b1c5-615deccaede2 service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received event network-vif-unplugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:41:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Instance destroyed successfully.
Oct 20 11:41:00 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lazy-loading 'resources' on Instance uuid 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1009283430',display_name='tempest-VolumesAdminNegativeTest-server-1009283430',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1009283430',id=4,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU6Kh2QbgahCSNiMzVaw3Di8NRILNAz1OKj0+CYZZqWDru/1JJFt1cZfIvPmdLFDxQv8L8c++J2xYlaZjV6LQlGPGcSx7D5eH4FVK7v59c7mAwEjy8IZq4mYCJsAeQDRA==',key_name='tempest-keypair-522061344',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42b0bf8e61964896a236f83d739a7366',ramdisk_id='',reservation_id='r-oow34t0i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-617790048',owner_user_name='tempest-VolumesAdminNegativeTest-617790048-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='555d42ae165f487a9fe068dd8b06e6cc',uuid=3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converting VIF {"id": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "address": "fa:16:3e:93:53:8b", "network": {"id": "0896702f-1650-40c0-8063-b63283eb2ef4", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-851133403-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42b0bf8e61964896a236f83d739a7366", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491c6c41-56", "ovs_interfaceid": "491c6c41-5608-42cd-a9d5-a1893dbbacf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:53:8b,bridge_name='br-int',has_traffic_filtering=True,id=491c6c41-5608-42cd-a9d5-a1893dbbacf9,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491c6c41-56') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG os_vif [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:53:8b,bridge_name='br-int',has_traffic_filtering=True,id=491c6c41-5608-42cd-a9d5-a1893dbbacf9,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491c6c41-56') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap491c6c41-56, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df28e83f-3a65-4c2d-a981-061f87e822e2) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:41:00 user nova-compute[74241]: INFO os_vif [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:53:8b,bridge_name='br-int',has_traffic_filtering=True,id=491c6c41-5608-42cd-a9d5-a1893dbbacf9,network=Network(0896702f-1650-40c0-8063-b63283eb2ef4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491c6c41-56')
Oct 20 11:41:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Deleting instance files /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d_del
Oct 20 11:41:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Deletion of /opt/stack/data/nova/instances/3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d_del complete
Oct 20 11:41:00 user nova-compute[74241]: INFO nova.compute.manager [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 11:41:00 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:41:00 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:41:01 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Took 0.99 seconds to deallocate network for instance.
Oct 20 11:41:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:01 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Deleted allocations for instance 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d
Oct 20 11:41:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f77ebdc0-cb82-419d-8a11-f4f1628b0883 tempest-VolumesAdminNegativeTest-617790048 tempest-VolumesAdminNegativeTest-617790048-project-member] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.428s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-a08ec2e6-15de-4789-831c-96d89da02a8e req-c5c1464b-bce6-4e1f-83e5-ccb873f5fb5f service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received event network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a08ec2e6-15de-4789-831c-96d89da02a8e req-c5c1464b-bce6-4e1f-83e5-ccb873f5fb5f service nova] Acquiring lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a08ec2e6-15de-4789-831c-96d89da02a8e req-c5c1464b-bce6-4e1f-83e5-ccb873f5fb5f service nova] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a08ec2e6-15de-4789-831c-96d89da02a8e req-c5c1464b-bce6-4e1f-83e5-ccb873f5fb5f service nova] Lock "3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-a08ec2e6-15de-4789-831c-96d89da02a8e req-c5c1464b-bce6-4e1f-83e5-ccb873f5fb5f service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] No waiting events found dispatching network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:41:01 user nova-compute[74241]: WARNING nova.compute.manager [req-a08ec2e6-15de-4789-831c-96d89da02a8e req-c5c1464b-bce6-4e1f-83e5-ccb873f5fb5f service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received unexpected event network-vif-plugged-491c6c41-5608-42cd-a9d5-a1893dbbacf9 for instance with vm_state deleted and task_state None.
Oct 20 11:41:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-a08ec2e6-15de-4789-831c-96d89da02a8e req-c5c1464b-bce6-4e1f-83e5-ccb873f5fb5f service nova] [instance: 3b2b6ab9-c1fc-40ec-b2f4-519b12e6532d] Received event network-vif-deleted-491c6c41-5608-42cd-a9d5-a1893dbbacf9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:41:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:41:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:41:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:41:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:41:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:41:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "87ba8898-bf7b-4e12-9891-f665fd89134d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:41:49 user nova-compute[74241]: INFO nova.compute.claims [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Claim successful on node user
Oct 20 11:41:49 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:41:49 user nova-compute[74241]: DEBUG nova.network.neutron [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:41:49 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:41:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG nova.policy [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81bd4a77e2a545ab888a85c2e561ef04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a1a3993ce9641a5915b335135b32672', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:41:50 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Creating image(s)
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "/opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "/opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "/opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.238s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.229s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk 1073741824" returned: 0 in 0.264s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.499s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Successfully created port: 21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.585s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Cannot resize image /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Ensure instance console log exists: /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.network.neutron [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Successfully updated port: 21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "refresh_cache-87ba8898-bf7b-4e12-9891-f665fd89134d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquired lock "refresh_cache-87ba8898-bf7b-4e12-9891-f665fd89134d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.network.neutron [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.compute.manager [req-f67c8262-ccfe-4016-bb00-1283e11a553b req-860675cb-3c55-4127-8d2f-52fe5b7a49b4 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received event network-changed-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.compute.manager [req-f67c8262-ccfe-4016-bb00-1283e11a553b req-860675cb-3c55-4127-8d2f-52fe5b7a49b4 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Refreshing instance network info cache due to event network-changed-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f67c8262-ccfe-4016-bb00-1283e11a553b req-860675cb-3c55-4127-8d2f-52fe5b7a49b4 service nova] Acquiring lock "refresh_cache-87ba8898-bf7b-4e12-9891-f665fd89134d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.network.neutron [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.network.neutron [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Updating instance_info_cache with network_info: [{"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Releasing lock "refresh_cache-87ba8898-bf7b-4e12-9891-f665fd89134d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Instance network_info: |[{"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f67c8262-ccfe-4016-bb00-1283e11a553b req-860675cb-3c55-4127-8d2f-52fe5b7a49b4 service nova] Acquired lock "refresh_cache-87ba8898-bf7b-4e12-9891-f665fd89134d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-f67c8262-ccfe-4016-bb00-1283e11a553b req-860675cb-3c55-4127-8d2f-52fe5b7a49b4 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Refreshing network info cache for port 21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Start _get_guest_xml network_info=[{"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:41:52 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:41:52 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:41:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1426871078',display_name='tempest-ServersNegativeTestJSON-server-1426871078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1426871078',id=18,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1a3993ce9641a5915b335135b32672',ramdisk_id='',reservation_id='r-m0oego36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-819929623',owner_user_name='tempest-ServersNegativeTestJSON-819929623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:41:50Z,user_data=None,user_id='81bd4a77e2a545ab888a85c2e561ef04',uuid=87ba8898-bf7b-4e12-9891-f665fd89134d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converting VIF {"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:13:9d,bridge_name='br-int',has_traffic_filtering=True,id=21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cdd447-4d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.objects.instance [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lazy-loading 'pci_devices' on Instance uuid 87ba8898-bf7b-4e12-9891-f665fd89134d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:41:53 user nova-compute[74241]:   <uuid>87ba8898-bf7b-4e12-9891-f665fd89134d</uuid>
Oct 20 11:41:53 user nova-compute[74241]:   <name>instance-00000012</name>
Oct 20 11:41:53 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:41:53 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:41:53 user nova-compute[74241]:   <metadata>
Oct 20 11:41:53 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:41:53 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:41:53 user nova-compute[74241]:       <nova:name>tempest-ServersNegativeTestJSON-server-1426871078</nova:name>
Oct 20 11:41:53 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:41:52</nova:creationTime>
Oct 20 11:41:53 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:41:53 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:41:53 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:41:53 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:41:53 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:41:53 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:41:53 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:41:53 user nova-compute[74241]:       <nova:owner>
Oct 20 11:41:53 user nova-compute[74241]:         <nova:user uuid="81bd4a77e2a545ab888a85c2e561ef04">tempest-ServersNegativeTestJSON-819929623-project-member</nova:user>
Oct 20 11:41:53 user nova-compute[74241]:         <nova:project uuid="3a1a3993ce9641a5915b335135b32672">tempest-ServersNegativeTestJSON-819929623</nova:project>
Oct 20 11:41:53 user nova-compute[74241]:       </nova:owner>
Oct 20 11:41:53 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:41:53 user nova-compute[74241]:       <nova:ports>
Oct 20 11:41:53 user nova-compute[74241]:         <nova:port uuid="21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9">
Oct 20 11:41:53 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 11:41:53 user nova-compute[74241]:         </nova:port>
Oct 20 11:41:53 user nova-compute[74241]:       </nova:ports>
Oct 20 11:41:53 user nova-compute[74241]:     </nova:instance>
Oct 20 11:41:53 user nova-compute[74241]:   </metadata>
Oct 20 11:41:53 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:41:53 user nova-compute[74241]:     <system>
Oct 20 11:41:53 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:41:53 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:41:53 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:41:53 user nova-compute[74241]:       <entry name="serial">87ba8898-bf7b-4e12-9891-f665fd89134d</entry>
Oct 20 11:41:53 user nova-compute[74241]:       <entry name="uuid">87ba8898-bf7b-4e12-9891-f665fd89134d</entry>
Oct 20 11:41:53 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:41:53 user nova-compute[74241]:     </system>
Oct 20 11:41:53 user nova-compute[74241]:   </sysinfo>
Oct 20 11:41:53 user nova-compute[74241]:   <os>
Oct 20 11:41:53 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:41:53 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:41:53 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:41:53 user nova-compute[74241]:   </os>
Oct 20 11:41:53 user nova-compute[74241]:   <features>
Oct 20 11:41:53 user nova-compute[74241]:     <acpi/>
Oct 20 11:41:53 user nova-compute[74241]:     <apic/>
Oct 20 11:41:53 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:41:53 user nova-compute[74241]:   </features>
Oct 20 11:41:53 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:41:53 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:41:53 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:41:53 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:41:53 user nova-compute[74241]:   </clock>
Oct 20 11:41:53 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:41:53 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:41:53 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:41:53 user nova-compute[74241]:   </cpu>
Oct 20 11:41:53 user nova-compute[74241]:   <devices>
Oct 20 11:41:53 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:41:53 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:41:53 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk"/>
Oct 20 11:41:53 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:41:53 user nova-compute[74241]:     </disk>
Oct 20 11:41:53 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:41:53 user nova-compute[74241]:       <mac address="fa:16:3e:32:13:9d"/>
Oct 20 11:41:53 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:41:53 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:41:53 user nova-compute[74241]:       <target dev="tap21cdd447-4d"/>
Oct 20 11:41:53 user nova-compute[74241]:     </interface>
Oct 20 11:41:53 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:41:53 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/console.log" append="off"/>
Oct 20 11:41:53 user nova-compute[74241]:     </serial>
Oct 20 11:41:53 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:41:53 user nova-compute[74241]:     <video>
Oct 20 11:41:53 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:41:53 user nova-compute[74241]:     </video>
Oct 20 11:41:53 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:41:53 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:41:53 user nova-compute[74241]:     </rng>
Oct 20 11:41:53 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:41:53 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:41:53 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:41:53 user nova-compute[74241]:     </memballoon>
Oct 20 11:41:53 user nova-compute[74241]:   </devices>
Oct 20 11:41:53 user nova-compute[74241]: </domain>
Oct 20 11:41:53 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1426871078',display_name='tempest-ServersNegativeTestJSON-server-1426871078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1426871078',id=18,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a1a3993ce9641a5915b335135b32672',ramdisk_id='',reservation_id='r-m0oego36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-819929623',owner_user_name='tempest-ServersNegativeTestJSON-819929623-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:41:50Z,user_data=None,user_id='81bd4a77e2a545ab888a85c2e561ef04',uuid=87ba8898-bf7b-4e12-9891-f665fd89134d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converting VIF {"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:13:9d,bridge_name='br-int',has_traffic_filtering=True,id=21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cdd447-4d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG os_vif [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:13:9d,bridge_name='br-int',has_traffic_filtering=True,id=21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cdd447-4d') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0400250-7027-53b7-9561-20572632913b', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21cdd447-4d, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21cdd447-4d, col_values=(('qos', UUID('3f893cbf-30d2-4023-9dda-d7951afa225c')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21cdd447-4d, col_values=(('external_ids', {'iface-id': '21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:13:9d', 'vm-uuid': '87ba8898-bf7b-4e12-9891-f665fd89134d'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:53 user nova-compute[74241]: INFO os_vif [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:13:9d,bridge_name='br-int',has_traffic_filtering=True,id=21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cdd447-4d')
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] No VIF found with MAC fa:16:3e:32:13:9d, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.network.neutron [req-f67c8262-ccfe-4016-bb00-1283e11a553b req-860675cb-3c55-4127-8d2f-52fe5b7a49b4 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Updated VIF entry in instance network info cache for port 21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG nova.network.neutron [req-f67c8262-ccfe-4016-bb00-1283e11a553b req-860675cb-3c55-4127-8d2f-52fe5b7a49b4 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Updating instance_info_cache with network_info: [{"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f67c8262-ccfe-4016-bb00-1283e11a553b req-860675cb-3c55-4127-8d2f-52fe5b7a49b4 service nova] Releasing lock "refresh_cache-87ba8898-bf7b-4e12-9891-f665fd89134d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:41:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-92bb9c02-1c6a-4038-9bba-ff076907825d req-339ca3ef-99b8-4acd-a871-3c3c7bec0f38 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received event network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-92bb9c02-1c6a-4038-9bba-ff076907825d req-339ca3ef-99b8-4acd-a871-3c3c7bec0f38 service nova] Acquiring lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-92bb9c02-1c6a-4038-9bba-ff076907825d req-339ca3ef-99b8-4acd-a871-3c3c7bec0f38 service nova] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-92bb9c02-1c6a-4038-9bba-ff076907825d req-339ca3ef-99b8-4acd-a871-3c3c7bec0f38 service nova] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-92bb9c02-1c6a-4038-9bba-ff076907825d req-339ca3ef-99b8-4acd-a871-3c3c7bec0f38 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] No waiting events found dispatching network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:41:57 user nova-compute[74241]: WARNING nova.compute.manager [req-92bb9c02-1c6a-4038-9bba-ff076907825d req-339ca3ef-99b8-4acd-a871-3c3c7bec0f38 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received unexpected event network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 for instance with vm_state building and task_state spawning.
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-c390b3f4-e14b-4b1b-88ab-08a9a28f7048 req-0b7481cd-a02b-47fa-b1cb-69184a3e1829 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received event network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c390b3f4-e14b-4b1b-88ab-08a9a28f7048 req-0b7481cd-a02b-47fa-b1cb-69184a3e1829 service nova] Acquiring lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c390b3f4-e14b-4b1b-88ab-08a9a28f7048 req-0b7481cd-a02b-47fa-b1cb-69184a3e1829 service nova] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c390b3f4-e14b-4b1b-88ab-08a9a28f7048 req-0b7481cd-a02b-47fa-b1cb-69184a3e1829 service nova] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-c390b3f4-e14b-4b1b-88ab-08a9a28f7048 req-0b7481cd-a02b-47fa-b1cb-69184a3e1829 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] No waiting events found dispatching network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:41:57 user nova-compute[74241]: WARNING nova.compute.manager [req-c390b3f4-e14b-4b1b-88ab-08a9a28f7048 req-0b7481cd-a02b-47fa-b1cb-69184a3e1829 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received unexpected event network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 for instance with vm_state building and task_state spawning.
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:41:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:41:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=25.559932708740234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:41:57 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Instance spawned successfully.
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:41:57 user nova-compute[74241]: INFO nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Took 7.35 seconds to spawn the instance on the hypervisor.
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance c19279cb-daa2-491e-8288-e0f2ce35dc1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 217655bc-d22a-4c39-9522-29f189a6bb5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 067921cd-6e00-4c59-ba59-9cdd613687cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5600826e-10a2-4079-bb18-a652aa279f45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 87ba8898-bf7b-4e12-9891-f665fd89134d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:41:57 user nova-compute[74241]: INFO nova.compute.manager [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Took 8.24 seconds to build instance.
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-57bffd61-fa8a-4216-998b-050e39d9d143 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.358s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:41:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:41:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:41:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:41:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:41:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:41:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:41:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:41:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:41:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updating instance_info_cache with network_info: [{"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:41:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-c19279cb-daa2-491e-8288-e0f2ce35dc1b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:41:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:41:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:41:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:41:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:41:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:41:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:42:09 user nova-compute[74241]: INFO nova.compute.claims [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Claim successful on node user
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "031a2001-57b8-4411-bed1-69eac953d40b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.719s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.462s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:42:09 user nova-compute[74241]: INFO nova.compute.claims [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Claim successful on node user
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:42:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:42:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.policy [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f2c95648d124219b0505d18ebc85f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2181a0d9a273487eaa81ad8acd48c8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:42:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Creating image(s)
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.207s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.134s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:42:10 user nova-compute[74241]: INFO nova.compute.claims [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Claim successful on node user
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.242s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk 1073741824" returned: 0 in 0.071s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:42:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.policy [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ad19e5d57684ea2ae450fcc53ca8bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b379f1e29f94071a26728bdb59bbfcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.246s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:42:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:42:11 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Creating image(s)
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.network.neutron [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Successfully created port: d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Cannot resize image /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Ensure instance console log exists: /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.209s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.217s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.077s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk 1073741824" returned: 0 in 0.208s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.430s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Successfully created port: 9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.293s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:42:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:42:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:42:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Cannot resize image /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Ensure instance console log exists: /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:42:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Creating image(s)
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.policy [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ad19e5d57684ea2ae450fcc53ca8bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b379f1e29f94071a26728bdb59bbfcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.211s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.network.neutron [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Successfully updated port: d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-ae1bf4e4-ce49-4ec5-981d-07f62b0f91d0 req-8dfa6262-6f48-48f7-8998-275c3624a4bb service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-changed-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-ae1bf4e4-ce49-4ec5-981d-07f62b0f91d0 req-8dfa6262-6f48-48f7-8998-275c3624a4bb service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Refreshing instance network info cache due to event network-changed-d970e2bd-a050-4038-afec-cb86392153c9. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ae1bf4e4-ce49-4ec5-981d-07f62b0f91d0 req-8dfa6262-6f48-48f7-8998-275c3624a4bb service nova] Acquiring lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ae1bf4e4-ce49-4ec5-981d-07f62b0f91d0 req-8dfa6262-6f48-48f7-8998-275c3624a4bb service nova] Acquired lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.network.neutron [req-ae1bf4e4-ce49-4ec5-981d-07f62b0f91d0 req-8dfa6262-6f48-48f7-8998-275c3624a4bb service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Refreshing network info cache for port d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.207s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG nova.network.neutron [req-ae1bf4e4-ce49-4ec5-981d-07f62b0f91d0 req-8dfa6262-6f48-48f7-8998-275c3624a4bb service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk 1073741824" returned: 0 in 0.069s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-ae1bf4e4-ce49-4ec5-981d-07f62b0f91d0 req-8dfa6262-6f48-48f7-8998-275c3624a4bb service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Successfully updated port: 9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-fd3ca884-5afc-4c31-baef-fb701f5b2611 req-0358069d-2125-4bb4-9277-3a717be2daa5 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received event network-changed-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-fd3ca884-5afc-4c31-baef-fb701f5b2611 req-0358069d-2125-4bb4-9277-3a717be2daa5 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Refreshing instance network info cache due to event network-changed-980b963e-d9c0-43ce-b742-b40edfdd7b09. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fd3ca884-5afc-4c31-baef-fb701f5b2611 req-0358069d-2125-4bb4-9277-3a717be2daa5 service nova] Acquiring lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fd3ca884-5afc-4c31-baef-fb701f5b2611 req-0358069d-2125-4bb4-9277-3a717be2daa5 service nova] Acquired lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-fd3ca884-5afc-4c31-baef-fb701f5b2611 req-0358069d-2125-4bb4-9277-3a717be2daa5 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Refreshing network info cache for port 980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquired lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ae1bf4e4-ce49-4ec5-981d-07f62b0f91d0 req-8dfa6262-6f48-48f7-8998-275c3624a4bb service nova] Releasing lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquired lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-46e9e6e3-9097-49d2-b5c3-a081cc06b6b5 req-a17e2a0e-5709-4093-927e-eca89dd83507 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-changed-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-46e9e6e3-9097-49d2-b5c3-a081cc06b6b5 req-a17e2a0e-5709-4093-927e-eca89dd83507 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Refreshing instance network info cache due to event network-changed-9193aa87-6409-4548-812c-31bbc6605398. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-46e9e6e3-9097-49d2-b5c3-a081cc06b6b5 req-a17e2a0e-5709-4093-927e-eca89dd83507 service nova] Acquiring lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Cannot resize image /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Ensure instance console log exists: /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updating instance_info_cache with network_info: [{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Releasing lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance network_info: |[{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-46e9e6e3-9097-49d2-b5c3-a081cc06b6b5 req-a17e2a0e-5709-4093-927e-eca89dd83507 service nova] Acquired lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-46e9e6e3-9097-49d2-b5c3-a081cc06b6b5 req-a17e2a0e-5709-4093-927e-eca89dd83507 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Refreshing network info cache for port 9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Start _get_guest_xml network_info=[{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Successfully created port: 204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "067921cd-6e00-4c59-ba59-9cdd613687cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:13 user nova-compute[74241]: INFO nova.compute.manager [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Terminating instance
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.compute.manager [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:42:13 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:13 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1839366464',display_name='tempest-ServerRescueNegativeTestJSON-server-1839366464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1839366464',id=20,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-w5380cy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:11Z,user_data=None,user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=031a2001-57b8-4411-bed1-69eac953d40b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7e:75,bridge_name='br-int',has_traffic_filtering=True,id=9193aa87-6409-4548-812c-31bbc6605398,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9193aa87-64') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.objects.instance [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'pci_devices' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:42:13 user nova-compute[74241]:   <uuid>031a2001-57b8-4411-bed1-69eac953d40b</uuid>
Oct 20 11:42:13 user nova-compute[74241]:   <name>instance-00000014</name>
Oct 20 11:42:13 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:42:13 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:42:13 user nova-compute[74241]:   <metadata>
Oct 20 11:42:13 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:42:13 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:42:13 user nova-compute[74241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1839366464</nova:name>
Oct 20 11:42:13 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:42:13</nova:creationTime>
Oct 20 11:42:13 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:42:13 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:42:13 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:42:13 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:42:13 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:42:13 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:42:13 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:42:13 user nova-compute[74241]:       <nova:owner>
Oct 20 11:42:13 user nova-compute[74241]:         <nova:user uuid="6ad19e5d57684ea2ae450fcc53ca8bd7">tempest-ServerRescueNegativeTestJSON-1505666936-project-member</nova:user>
Oct 20 11:42:13 user nova-compute[74241]:         <nova:project uuid="6b379f1e29f94071a26728bdb59bbfcb">tempest-ServerRescueNegativeTestJSON-1505666936</nova:project>
Oct 20 11:42:13 user nova-compute[74241]:       </nova:owner>
Oct 20 11:42:13 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:42:13 user nova-compute[74241]:       <nova:ports>
Oct 20 11:42:13 user nova-compute[74241]:         <nova:port uuid="9193aa87-6409-4548-812c-31bbc6605398">
Oct 20 11:42:13 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:42:13 user nova-compute[74241]:         </nova:port>
Oct 20 11:42:13 user nova-compute[74241]:       </nova:ports>
Oct 20 11:42:13 user nova-compute[74241]:     </nova:instance>
Oct 20 11:42:13 user nova-compute[74241]:   </metadata>
Oct 20 11:42:13 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:42:13 user nova-compute[74241]:     <system>
Oct 20 11:42:13 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:42:13 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:42:13 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:42:13 user nova-compute[74241]:       <entry name="serial">031a2001-57b8-4411-bed1-69eac953d40b</entry>
Oct 20 11:42:13 user nova-compute[74241]:       <entry name="uuid">031a2001-57b8-4411-bed1-69eac953d40b</entry>
Oct 20 11:42:13 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:42:13 user nova-compute[74241]:     </system>
Oct 20 11:42:13 user nova-compute[74241]:   </sysinfo>
Oct 20 11:42:13 user nova-compute[74241]:   <os>
Oct 20 11:42:13 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:42:13 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:42:13 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:42:13 user nova-compute[74241]:   </os>
Oct 20 11:42:13 user nova-compute[74241]:   <features>
Oct 20 11:42:13 user nova-compute[74241]:     <acpi/>
Oct 20 11:42:13 user nova-compute[74241]:     <apic/>
Oct 20 11:42:13 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:42:13 user nova-compute[74241]:   </features>
Oct 20 11:42:13 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:42:13 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:42:13 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:42:13 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:42:13 user nova-compute[74241]:   </clock>
Oct 20 11:42:13 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:42:13 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:42:13 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:42:13 user nova-compute[74241]:   </cpu>
Oct 20 11:42:13 user nova-compute[74241]:   <devices>
Oct 20 11:42:13 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:42:13 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:42:13 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk"/>
Oct 20 11:42:13 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:42:13 user nova-compute[74241]:     </disk>
Oct 20 11:42:13 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:42:13 user nova-compute[74241]:       <mac address="fa:16:3e:a8:7e:75"/>
Oct 20 11:42:13 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:13 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:42:13 user nova-compute[74241]:       <target dev="tap9193aa87-64"/>
Oct 20 11:42:13 user nova-compute[74241]:     </interface>
Oct 20 11:42:13 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:42:13 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/console.log" append="off"/>
Oct 20 11:42:13 user nova-compute[74241]:     </serial>
Oct 20 11:42:13 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:42:13 user nova-compute[74241]:     <video>
Oct 20 11:42:13 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:13 user nova-compute[74241]:     </video>
Oct 20 11:42:13 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:42:13 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:42:13 user nova-compute[74241]:     </rng>
Oct 20 11:42:13 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:42:13 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:42:13 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:42:13 user nova-compute[74241]:     </memballoon>
Oct 20 11:42:13 user nova-compute[74241]:   </devices>
Oct 20 11:42:13 user nova-compute[74241]: </domain>
Oct 20 11:42:13 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1839366464',display_name='tempest-ServerRescueNegativeTestJSON-server-1839366464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1839366464',id=20,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-w5380cy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:11Z,user_data=None,user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=031a2001-57b8-4411-bed1-69eac953d40b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7e:75,bridge_name='br-int',has_traffic_filtering=True,id=9193aa87-6409-4548-812c-31bbc6605398,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9193aa87-64') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG os_vif [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7e:75,bridge_name='br-int',has_traffic_filtering=True,id=9193aa87-6409-4548-812c-31bbc6605398,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9193aa87-64') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20c8795a-8537-548c-a547-36f78f236fd2', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9193aa87-64, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9193aa87-64, col_values=(('qos', UUID('2fc375dc-25de-400c-8a59-3a163bb361f9')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9193aa87-64, col_values=(('external_ids', {'iface-id': '9193aa87-6409-4548-812c-31bbc6605398', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:7e:75', 'vm-uuid': '031a2001-57b8-4411-bed1-69eac953d40b'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:13 user nova-compute[74241]: INFO os_vif [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:7e:75,bridge_name='br-int',has_traffic_filtering=True,id=9193aa87-6409-4548-812c-31bbc6605398,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9193aa87-64')
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:42:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No VIF found with MAC fa:16:3e:a8:7e:75, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.neutron [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating instance_info_cache with network_info: [{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Releasing lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance network_info: |[{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Start _get_guest_xml network_info=[{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:42:14 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:14 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.objects.instance [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'pci_devices' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:42:14 user nova-compute[74241]:   <uuid>333dae7f-9914-4604-a36b-8e5d4d2a4bce</uuid>
Oct 20 11:42:14 user nova-compute[74241]:   <name>instance-00000013</name>
Oct 20 11:42:14 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:42:14 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:42:14 user nova-compute[74241]:   <metadata>
Oct 20 11:42:14 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:42:14 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:42:14 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeTestJSON-server-1214393435</nova:name>
Oct 20 11:42:14 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:42:14</nova:creationTime>
Oct 20 11:42:14 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:42:14 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:42:14 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:42:14 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:42:14 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:42:14 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:42:14 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:42:14 user nova-compute[74241]:       <nova:owner>
Oct 20 11:42:14 user nova-compute[74241]:         <nova:user uuid="8f2c95648d124219b0505d18ebc85f5d">tempest-AttachVolumeTestJSON-1958556215-project-member</nova:user>
Oct 20 11:42:14 user nova-compute[74241]:         <nova:project uuid="2181a0d9a273487eaa81ad8acd48c8e9">tempest-AttachVolumeTestJSON-1958556215</nova:project>
Oct 20 11:42:14 user nova-compute[74241]:       </nova:owner>
Oct 20 11:42:14 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:42:14 user nova-compute[74241]:       <nova:ports>
Oct 20 11:42:14 user nova-compute[74241]:         <nova:port uuid="d970e2bd-a050-4038-afec-cb86392153c9">
Oct 20 11:42:14 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 11:42:14 user nova-compute[74241]:         </nova:port>
Oct 20 11:42:14 user nova-compute[74241]:       </nova:ports>
Oct 20 11:42:14 user nova-compute[74241]:     </nova:instance>
Oct 20 11:42:14 user nova-compute[74241]:   </metadata>
Oct 20 11:42:14 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:42:14 user nova-compute[74241]:     <system>
Oct 20 11:42:14 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:42:14 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:42:14 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:42:14 user nova-compute[74241]:       <entry name="serial">333dae7f-9914-4604-a36b-8e5d4d2a4bce</entry>
Oct 20 11:42:14 user nova-compute[74241]:       <entry name="uuid">333dae7f-9914-4604-a36b-8e5d4d2a4bce</entry>
Oct 20 11:42:14 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:42:14 user nova-compute[74241]:     </system>
Oct 20 11:42:14 user nova-compute[74241]:   </sysinfo>
Oct 20 11:42:14 user nova-compute[74241]:   <os>
Oct 20 11:42:14 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:42:14 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:42:14 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:42:14 user nova-compute[74241]:   </os>
Oct 20 11:42:14 user nova-compute[74241]:   <features>
Oct 20 11:42:14 user nova-compute[74241]:     <acpi/>
Oct 20 11:42:14 user nova-compute[74241]:     <apic/>
Oct 20 11:42:14 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:42:14 user nova-compute[74241]:   </features>
Oct 20 11:42:14 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:42:14 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:42:14 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:42:14 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:42:14 user nova-compute[74241]:   </clock>
Oct 20 11:42:14 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:42:14 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:42:14 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:42:14 user nova-compute[74241]:   </cpu>
Oct 20 11:42:14 user nova-compute[74241]:   <devices>
Oct 20 11:42:14 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:42:14 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:42:14 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk"/>
Oct 20 11:42:14 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:42:14 user nova-compute[74241]:     </disk>
Oct 20 11:42:14 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:42:14 user nova-compute[74241]:       <mac address="fa:16:3e:4d:4b:43"/>
Oct 20 11:42:14 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:14 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:42:14 user nova-compute[74241]:       <target dev="tapd970e2bd-a0"/>
Oct 20 11:42:14 user nova-compute[74241]:     </interface>
Oct 20 11:42:14 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:42:14 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/console.log" append="off"/>
Oct 20 11:42:14 user nova-compute[74241]:     </serial>
Oct 20 11:42:14 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:42:14 user nova-compute[74241]:     <video>
Oct 20 11:42:14 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:14 user nova-compute[74241]:     </video>
Oct 20 11:42:14 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:42:14 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:42:14 user nova-compute[74241]:     </rng>
Oct 20 11:42:14 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:42:14 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:42:14 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:42:14 user nova-compute[74241]:     </memballoon>
Oct 20 11:42:14 user nova-compute[74241]:   </devices>
Oct 20 11:42:14 user nova-compute[74241]: </domain>
Oct 20 11:42:14 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG os_vif [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb8e2e0b-e8cf-527f-bbf2-270b077c0895', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd970e2bd-a0, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd970e2bd-a0, col_values=(('qos', UUID('a1a770e6-e7b7-40af-bc02-1b613b78fc08')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd970e2bd-a0, col_values=(('external_ids', {'iface-id': 'd970e2bd-a050-4038-afec-cb86392153c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:4b:43', 'vm-uuid': '333dae7f-9914-4604-a36b-8e5d4d2a4bce'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: INFO os_vif [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0')
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No VIF found with MAC fa:16:3e:4d:4b:43, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Successfully updated port: 204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquired lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.neutron [req-46e9e6e3-9097-49d2-b5c3-a081cc06b6b5 req-a17e2a0e-5709-4093-927e-eca89dd83507 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updated VIF entry in instance network info cache for port 9193aa87-6409-4548-812c-31bbc6605398. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.neutron [req-46e9e6e3-9097-49d2-b5c3-a081cc06b6b5 req-a17e2a0e-5709-4093-927e-eca89dd83507 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updating instance_info_cache with network_info: [{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-46e9e6e3-9097-49d2-b5c3-a081cc06b6b5 req-a17e2a0e-5709-4093-927e-eca89dd83507 service nova] Releasing lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.neutron [req-fd3ca884-5afc-4c31-baef-fb701f5b2611 req-0358069d-2125-4bb4-9277-3a717be2daa5 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Updated VIF entry in instance network info cache for port 980b963e-d9c0-43ce-b742-b40edfdd7b09. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.neutron [req-fd3ca884-5afc-4c31-baef-fb701f5b2611 req-0358069d-2125-4bb4-9277-3a717be2daa5 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Updating instance_info_cache with network_info: [{"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fd3ca884-5afc-4c31-baef-fb701f5b2611 req-0358069d-2125-4bb4-9277-3a717be2daa5 service nova] Releasing lock "refresh_cache-067921cd-6e00-4c59-ba59-9cdd613687cf" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received event network-vif-unplugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] Acquiring lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] No waiting events found dispatching network-vif-unplugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received event network-vif-unplugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received event network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] Acquiring lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] No waiting events found dispatching network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:14 user nova-compute[74241]: WARNING nova.compute.manager [req-baef85b9-0c01-49d0-acaf-5a97c57fdc8f req-921db1fb-9337-4479-8bab-6e79775f943d service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received unexpected event network-vif-plugged-980b963e-d9c0-43ce-b742-b40edfdd7b09 for instance with vm_state active and task_state deleting.
Oct 20 11:42:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.network.neutron [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updating instance_info_cache with network_info: [{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Releasing lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Instance network_info: |[{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Start _get_guest_xml network_info=[{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:42:15 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:15 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1970612555',display_name='tempest-ServerRescueNegativeTestJSON-server-1970612555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1970612555',id=21,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-gw13birt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:12Z,user_data=None,user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=b7db09b0-7889-4436-ba6a-6ed1a544c2b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f2:85,bridge_name='br-int',has_traffic_filtering=True,id=204f624b-c2b4-4e64-a2dd-23970b13fb6b,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204f624b-c2') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'pci_devices' on Instance uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:42:15 user nova-compute[74241]:   <uuid>b7db09b0-7889-4436-ba6a-6ed1a544c2b5</uuid>
Oct 20 11:42:15 user nova-compute[74241]:   <name>instance-00000015</name>
Oct 20 11:42:15 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:42:15 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:42:15 user nova-compute[74241]:   <metadata>
Oct 20 11:42:15 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:42:15 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:42:15 user nova-compute[74241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1970612555</nova:name>
Oct 20 11:42:15 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:42:15</nova:creationTime>
Oct 20 11:42:15 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:42:15 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:42:15 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:42:15 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:42:15 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:42:15 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:42:15 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:42:15 user nova-compute[74241]:       <nova:owner>
Oct 20 11:42:15 user nova-compute[74241]:         <nova:user uuid="6ad19e5d57684ea2ae450fcc53ca8bd7">tempest-ServerRescueNegativeTestJSON-1505666936-project-member</nova:user>
Oct 20 11:42:15 user nova-compute[74241]:         <nova:project uuid="6b379f1e29f94071a26728bdb59bbfcb">tempest-ServerRescueNegativeTestJSON-1505666936</nova:project>
Oct 20 11:42:15 user nova-compute[74241]:       </nova:owner>
Oct 20 11:42:15 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:42:15 user nova-compute[74241]:       <nova:ports>
Oct 20 11:42:15 user nova-compute[74241]:         <nova:port uuid="204f624b-c2b4-4e64-a2dd-23970b13fb6b">
Oct 20 11:42:15 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 11:42:15 user nova-compute[74241]:         </nova:port>
Oct 20 11:42:15 user nova-compute[74241]:       </nova:ports>
Oct 20 11:42:15 user nova-compute[74241]:     </nova:instance>
Oct 20 11:42:15 user nova-compute[74241]:   </metadata>
Oct 20 11:42:15 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:42:15 user nova-compute[74241]:     <system>
Oct 20 11:42:15 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:42:15 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:42:15 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:42:15 user nova-compute[74241]:       <entry name="serial">b7db09b0-7889-4436-ba6a-6ed1a544c2b5</entry>
Oct 20 11:42:15 user nova-compute[74241]:       <entry name="uuid">b7db09b0-7889-4436-ba6a-6ed1a544c2b5</entry>
Oct 20 11:42:15 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:42:15 user nova-compute[74241]:     </system>
Oct 20 11:42:15 user nova-compute[74241]:   </sysinfo>
Oct 20 11:42:15 user nova-compute[74241]:   <os>
Oct 20 11:42:15 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:42:15 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:42:15 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:42:15 user nova-compute[74241]:   </os>
Oct 20 11:42:15 user nova-compute[74241]:   <features>
Oct 20 11:42:15 user nova-compute[74241]:     <acpi/>
Oct 20 11:42:15 user nova-compute[74241]:     <apic/>
Oct 20 11:42:15 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:42:15 user nova-compute[74241]:   </features>
Oct 20 11:42:15 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:42:15 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:42:15 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:42:15 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:42:15 user nova-compute[74241]:   </clock>
Oct 20 11:42:15 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:42:15 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:42:15 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:42:15 user nova-compute[74241]:   </cpu>
Oct 20 11:42:15 user nova-compute[74241]:   <devices>
Oct 20 11:42:15 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:42:15 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:42:15 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk"/>
Oct 20 11:42:15 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:42:15 user nova-compute[74241]:     </disk>
Oct 20 11:42:15 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:42:15 user nova-compute[74241]:       <mac address="fa:16:3e:14:f2:85"/>
Oct 20 11:42:15 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:15 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:42:15 user nova-compute[74241]:       <target dev="tap204f624b-c2"/>
Oct 20 11:42:15 user nova-compute[74241]:     </interface>
Oct 20 11:42:15 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:42:15 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/console.log" append="off"/>
Oct 20 11:42:15 user nova-compute[74241]:     </serial>
Oct 20 11:42:15 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:42:15 user nova-compute[74241]:     <video>
Oct 20 11:42:15 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:15 user nova-compute[74241]:     </video>
Oct 20 11:42:15 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:42:15 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:42:15 user nova-compute[74241]:     </rng>
Oct 20 11:42:15 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:42:15 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:42:15 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:42:15 user nova-compute[74241]:     </memballoon>
Oct 20 11:42:15 user nova-compute[74241]:   </devices>
Oct 20 11:42:15 user nova-compute[74241]: </domain>
Oct 20 11:42:15 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1970612555',display_name='tempest-ServerRescueNegativeTestJSON-server-1970612555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1970612555',id=21,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-gw13birt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:12Z,user_data=None,user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=b7db09b0-7889-4436-ba6a-6ed1a544c2b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:f2:85,bridge_name='br-int',has_traffic_filtering=True,id=204f624b-c2b4-4e64-a2dd-23970b13fb6b,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204f624b-c2') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG os_vif [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f2:85,bridge_name='br-int',has_traffic_filtering=True,id=204f624b-c2b4-4e64-a2dd-23970b13fb6b,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204f624b-c2') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '113599db-5ef5-591d-838f-94097302a525', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap204f624b-c2, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap204f624b-c2, col_values=(('qos', UUID('cc671072-4263-45dd-8015-0379c54d04f3')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap204f624b-c2, col_values=(('external_ids', {'iface-id': '204f624b-c2b4-4e64-a2dd-23970b13fb6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:f2:85', 'vm-uuid': 'b7db09b0-7889-4436-ba6a-6ed1a544c2b5'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-0486ac35-16f5-466f-9aeb-8c443cfecc44 req-47a098c8-3173-4b05-b6fb-a981c20ec4c7 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-changed-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-0486ac35-16f5-466f-9aeb-8c443cfecc44 req-47a098c8-3173-4b05-b6fb-a981c20ec4c7 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Refreshing instance network info cache due to event network-changed-204f624b-c2b4-4e64-a2dd-23970b13fb6b. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0486ac35-16f5-466f-9aeb-8c443cfecc44 req-47a098c8-3173-4b05-b6fb-a981c20ec4c7 service nova] Acquiring lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0486ac35-16f5-466f-9aeb-8c443cfecc44 req-47a098c8-3173-4b05-b6fb-a981c20ec4c7 service nova] Acquired lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.network.neutron [req-0486ac35-16f5-466f-9aeb-8c443cfecc44 req-47a098c8-3173-4b05-b6fb-a981c20ec4c7 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Refreshing network info cache for port 204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: INFO os_vif [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:f2:85,bridge_name='br-int',has_traffic_filtering=True,id=204f624b-c2b4-4e64-a2dd-23970b13fb6b,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204f624b-c2')
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No VIF found with MAC fa:16:3e:14:f2:85, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.network.neutron [req-0486ac35-16f5-466f-9aeb-8c443cfecc44 req-47a098c8-3173-4b05-b6fb-a981c20ec4c7 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updated VIF entry in instance network info cache for port 204f624b-c2b4-4e64-a2dd-23970b13fb6b. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG nova.network.neutron [req-0486ac35-16f5-466f-9aeb-8c443cfecc44 req-47a098c8-3173-4b05-b6fb-a981c20ec4c7 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updating instance_info_cache with network_info: [{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0486ac35-16f5-466f-9aeb-8c443cfecc44 req-47a098c8-3173-4b05-b6fb-a981c20ec4c7 service nova] Releasing lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-66c1ab79-165d-4f7f-a26c-723b665849e9 req-1c979c41-b1ae-401e-a145-d57db1bc83e3 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-changed-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-66c1ab79-165d-4f7f-a26c-723b665849e9 req-1c979c41-b1ae-401e-a145-d57db1bc83e3 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Refreshing instance network info cache due to event network-changed-057c0964-5838-4c58-84aa-e479c46f8835. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-66c1ab79-165d-4f7f-a26c-723b665849e9 req-1c979c41-b1ae-401e-a145-d57db1bc83e3 service nova] Acquiring lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-66c1ab79-165d-4f7f-a26c-723b665849e9 req-1c979c41-b1ae-401e-a145-d57db1bc83e3 service nova] Acquired lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-66c1ab79-165d-4f7f-a26c-723b665849e9 req-1c979c41-b1ae-401e-a145-d57db1bc83e3 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Refreshing network info cache for port 057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:42:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Instance destroyed successfully.
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.objects.instance [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'resources' on Instance uuid 067921cd-6e00-4c59-ba59-9cdd613687cf {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1902077207',display_name='tempest-AttachVolumeNegativeTest-server-1902077207',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1902077207',id=16,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHkP56q2PPSoK0iBQYvQC8g7fhR2TIY6xz6oQXwUMZMvKWegjRMhavrmAWoNRUWEOtkv1dpGrN64EAMi/mahHezoYI0uEEw4r111/TlOXAr09MxAETG/nY3fPWeWK+5mKA==',key_name='tempest-keypair-936270826',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:40:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-d7nn5dnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=067921cd-6e00-4c59-ba59-9cdd613687cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "address": "fa:16:3e:d7:bd:c7", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980b963e-d9", "ovs_interfaceid": "980b963e-d9c0-43ce-b742-b40edfdd7b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:bd:c7,bridge_name='br-int',has_traffic_filtering=True,id=980b963e-d9c0-43ce-b742-b40edfdd7b09,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980b963e-d9') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG os_vif [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:bd:c7,bridge_name='br-int',has_traffic_filtering=True,id=980b963e-d9c0-43ce-b742-b40edfdd7b09,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980b963e-d9') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap980b963e-d9, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f2e7adc7-d7b9-4df2-bcae-625eb1f84426) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:16 user nova-compute[74241]: INFO os_vif [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:bd:c7,bridge_name='br-int',has_traffic_filtering=True,id=980b963e-d9c0-43ce-b742-b40edfdd7b09,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980b963e-d9')
Oct 20 11:42:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Deleting instance files /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf_del
Oct 20 11:42:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Deletion of /opt/stack/data/nova/instances/067921cd-6e00-4c59-ba59-9cdd613687cf_del complete
Oct 20 11:42:16 user nova-compute[74241]: INFO nova.compute.manager [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Took 2.97 seconds to destroy the instance on the hypervisor.
Oct 20 11:42:16 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-66c1ab79-165d-4f7f-a26c-723b665849e9 req-1c979c41-b1ae-401e-a145-d57db1bc83e3 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updated VIF entry in instance network info cache for port 057c0964-5838-4c58-84aa-e479c46f8835. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-66c1ab79-165d-4f7f-a26c-723b665849e9 req-1c979c41-b1ae-401e-a145-d57db1bc83e3 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-66c1ab79-165d-4f7f-a26c-723b665849e9 req-1c979c41-b1ae-401e-a145-d57db1bc83e3 service nova] Releasing lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:17 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:17 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Took 0.98 seconds to deallocate network for instance.
Oct 20 11:42:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Deleted allocations for instance 067921cd-6e00-4c59-ba59-9cdd613687cf
Oct 20 11:42:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] [instance: 067921cd-6e00-4c59-ba59-9cdd613687cf] Received event network-vif-deleted-980b963e-d9c0-43ce-b742-b40edfdd7b09 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:18 user nova-compute[74241]: WARNING nova.compute.manager [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state building and task_state spawning.
Oct 20 11:42:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:18 user nova-compute[74241]: WARNING nova.compute.manager [req-81066def-d027-44d7-8e70-849e010b7bda req-58ac4f69-7138-4d20-a4fd-049a3b0a68a4 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state building and task_state spawning.
Oct 20 11:42:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ff193a66-bb32-41fe-a1d7-2b2be77116d9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "067921cd-6e00-4c59-ba59-9cdd613687cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.686s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] No waiting events found dispatching network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:20 user nova-compute[74241]: WARNING nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received unexpected event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b for instance with vm_state building and task_state spawning.
Oct 20 11:42:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] No waiting events found dispatching network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:20 user nova-compute[74241]: WARNING nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received unexpected event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b for instance with vm_state building and task_state spawning.
Oct 20 11:42:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:20 user nova-compute[74241]: WARNING nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state building and task_state spawning.
Oct 20 11:42:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:20 user nova-compute[74241]: WARNING nova.compute.manager [req-d426c8d8-136b-4232-98e6-a2810662c706 req-e8ae3316-b99c-44c4-ad80-4bd36025267d service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state building and task_state spawning.
Oct 20 11:42:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:42:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance spawned successfully.
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:42:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance spawned successfully.
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:42:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Instance spawned successfully.
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:21 user nova-compute[74241]: INFO nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Took 11.60 seconds to spawn the instance on the hypervisor.
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:42:21 user nova-compute[74241]: INFO nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Took 10.76 seconds to spawn the instance on the hypervisor.
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:42:21 user nova-compute[74241]: INFO nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Took 9.44 seconds to spawn the instance on the hypervisor.
Oct 20 11:42:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:42:21 user nova-compute[74241]: INFO nova.compute.manager [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Took 12.50 seconds to build instance.
Oct 20 11:42:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fea5efcc-9dc1-432a-b9db-ed21fcdb2de5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "031a2001-57b8-4411-bed1-69eac953d40b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.656s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:21 user nova-compute[74241]: INFO nova.compute.manager [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Took 12.87 seconds to build instance.
Oct 20 11:42:22 user nova-compute[74241]: INFO nova.compute.manager [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Took 11.62 seconds to build instance.
Oct 20 11:42:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-100ff20c-c827-46fe-b4cd-f37b73a599fd tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.994s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-84b701e7-677e-4cdd-9c83-5a0764ad8697 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.778s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:29 user nova-compute[74241]: INFO nova.compute.manager [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Detaching volume daa4dbd3-121d-416b-8070-2e3b8616b91f
Oct 20 11:42:30 user nova-compute[74241]: INFO nova.virt.block_device [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Attempting to driver detach volume daa4dbd3-121d-416b-8070-2e3b8616b91f from mountpoint /dev/vdb
Oct 20 11:42:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Attempting to detach device vdb from instance c19279cb-daa2-491e-8288-e0f2ce35dc1b from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:42:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:42:30 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:42:30 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:42:30 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:42:30 user nova-compute[74241]:   <serial>daa4dbd3-121d-416b-8070-2e3b8616b91f</serial>
Oct 20 11:42:30 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 11:42:30 user nova-compute[74241]: </disk>
Oct 20 11:42:30 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:42:30 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully detached device vdb from instance c19279cb-daa2-491e-8288-e0f2ce35dc1b from the persistent domain config.
Oct 20 11:42:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c19279cb-daa2-491e-8288-e0f2ce35dc1b from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:42:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:42:30 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:42:30 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:42:30 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:42:30 user nova-compute[74241]:   <serial>daa4dbd3-121d-416b-8070-2e3b8616b91f</serial>
Oct 20 11:42:30 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 11:42:30 user nova-compute[74241]: </disk>
Oct 20 11:42:30 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:42:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c19279cb-daa2-491e-8288-e0f2ce35dc1b {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:42:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "a0011656-ed39-48af-a10a-59a4e2305a82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "a0011656-ed39-48af-a10a-59a4e2305a82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:42:37 user nova-compute[74241]: INFO nova.compute.claims [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Claim successful on node user
Oct 20 11:42:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.network.neutron [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:42:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.policy [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b107060251349c7b7b598dd92e3dbfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f944e9407ab34d048a82723b3fbae0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:42:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Creating image(s)
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "/opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "/opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.204s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG nova.network.neutron [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Successfully created port: 39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk 1073741824" returned: 0 in 0.068s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Cannot resize image /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Ensure instance console log exists: /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:38 user nova-compute[74241]: DEBUG nova.network.neutron [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Successfully updated port: 39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "refresh_cache-a0011656-ed39-48af-a10a-59a4e2305a82" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquired lock "refresh_cache-a0011656-ed39-48af-a10a-59a4e2305a82" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-b7c27476-206c-4ba2-8af7-c9714fd2bed2 req-af137a7d-919c-4eed-9436-ff1b9122baea service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received event network-changed-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-b7c27476-206c-4ba2-8af7-c9714fd2bed2 req-af137a7d-919c-4eed-9436-ff1b9122baea service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Refreshing instance network info cache due to event network-changed-39a9e83f-4898-4fbb-bb31-8f525be4bf33. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7c27476-206c-4ba2-8af7-c9714fd2bed2 req-af137a7d-919c-4eed-9436-ff1b9122baea service nova] Acquiring lock "refresh_cache-a0011656-ed39-48af-a10a-59a4e2305a82" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Updating instance_info_cache with network_info: [{"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Releasing lock "refresh_cache-a0011656-ed39-48af-a10a-59a4e2305a82" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Instance network_info: |[{"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7c27476-206c-4ba2-8af7-c9714fd2bed2 req-af137a7d-919c-4eed-9436-ff1b9122baea service nova] Acquired lock "refresh_cache-a0011656-ed39-48af-a10a-59a4e2305a82" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.neutron [req-b7c27476-206c-4ba2-8af7-c9714fd2bed2 req-af137a7d-919c-4eed-9436-ff1b9122baea service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Refreshing network info cache for port 39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Start _get_guest_xml network_info=[{"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:42:39 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:39 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2112730253',display_name='tempest-VolumesActionsTest-instance-2112730253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2112730253',id=22,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f944e9407ab34d048a82723b3fbae0ce',ramdisk_id='',reservation_id='r-llg27358',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-710267249',owner_user_name='tempest-VolumesActionsTest-710267249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:38Z,user_data=None,user_id='9b107060251349c7b7b598dd92e3dbfa',uuid=a0011656-ed39-48af-a10a-59a4e2305a82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Converting VIF {"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=39a9e83f-4898-4fbb-bb31-8f525be4bf33,network=Network(923e569b-1157-4218-98e2-577a965c7d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a9e83f-48') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.objects.instance [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lazy-loading 'pci_devices' on Instance uuid a0011656-ed39-48af-a10a-59a4e2305a82 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:42:39 user nova-compute[74241]:   <uuid>a0011656-ed39-48af-a10a-59a4e2305a82</uuid>
Oct 20 11:42:39 user nova-compute[74241]:   <name>instance-00000016</name>
Oct 20 11:42:39 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:42:39 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:42:39 user nova-compute[74241]:   <metadata>
Oct 20 11:42:39 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:42:39 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:42:39 user nova-compute[74241]:       <nova:name>tempest-VolumesActionsTest-instance-2112730253</nova:name>
Oct 20 11:42:39 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:42:39</nova:creationTime>
Oct 20 11:42:39 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:42:39 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:42:39 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:42:39 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:42:39 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:42:39 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:42:39 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:42:39 user nova-compute[74241]:       <nova:owner>
Oct 20 11:42:39 user nova-compute[74241]:         <nova:user uuid="9b107060251349c7b7b598dd92e3dbfa">tempest-VolumesActionsTest-710267249-project-member</nova:user>
Oct 20 11:42:39 user nova-compute[74241]:         <nova:project uuid="f944e9407ab34d048a82723b3fbae0ce">tempest-VolumesActionsTest-710267249</nova:project>
Oct 20 11:42:39 user nova-compute[74241]:       </nova:owner>
Oct 20 11:42:39 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:42:39 user nova-compute[74241]:       <nova:ports>
Oct 20 11:42:39 user nova-compute[74241]:         <nova:port uuid="39a9e83f-4898-4fbb-bb31-8f525be4bf33">
Oct 20 11:42:39 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 11:42:39 user nova-compute[74241]:         </nova:port>
Oct 20 11:42:39 user nova-compute[74241]:       </nova:ports>
Oct 20 11:42:39 user nova-compute[74241]:     </nova:instance>
Oct 20 11:42:39 user nova-compute[74241]:   </metadata>
Oct 20 11:42:39 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:42:39 user nova-compute[74241]:     <system>
Oct 20 11:42:39 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:42:39 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:42:39 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:42:39 user nova-compute[74241]:       <entry name="serial">a0011656-ed39-48af-a10a-59a4e2305a82</entry>
Oct 20 11:42:39 user nova-compute[74241]:       <entry name="uuid">a0011656-ed39-48af-a10a-59a4e2305a82</entry>
Oct 20 11:42:39 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:42:39 user nova-compute[74241]:     </system>
Oct 20 11:42:39 user nova-compute[74241]:   </sysinfo>
Oct 20 11:42:39 user nova-compute[74241]:   <os>
Oct 20 11:42:39 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:42:39 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:42:39 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:42:39 user nova-compute[74241]:   </os>
Oct 20 11:42:39 user nova-compute[74241]:   <features>
Oct 20 11:42:39 user nova-compute[74241]:     <acpi/>
Oct 20 11:42:39 user nova-compute[74241]:     <apic/>
Oct 20 11:42:39 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:42:39 user nova-compute[74241]:   </features>
Oct 20 11:42:39 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:42:39 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:42:39 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:42:39 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:42:39 user nova-compute[74241]:   </clock>
Oct 20 11:42:39 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:42:39 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:42:39 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:42:39 user nova-compute[74241]:   </cpu>
Oct 20 11:42:39 user nova-compute[74241]:   <devices>
Oct 20 11:42:39 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:42:39 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:42:39 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk"/>
Oct 20 11:42:39 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:42:39 user nova-compute[74241]:     </disk>
Oct 20 11:42:39 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:42:39 user nova-compute[74241]:       <mac address="fa:16:3e:bf:72:a6"/>
Oct 20 11:42:39 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:39 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:42:39 user nova-compute[74241]:       <target dev="tap39a9e83f-48"/>
Oct 20 11:42:39 user nova-compute[74241]:     </interface>
Oct 20 11:42:39 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:42:39 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/console.log" append="off"/>
Oct 20 11:42:39 user nova-compute[74241]:     </serial>
Oct 20 11:42:39 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:42:39 user nova-compute[74241]:     <video>
Oct 20 11:42:39 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:39 user nova-compute[74241]:     </video>
Oct 20 11:42:39 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:42:39 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:42:39 user nova-compute[74241]:     </rng>
Oct 20 11:42:39 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:42:39 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:42:39 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:42:39 user nova-compute[74241]:     </memballoon>
Oct 20 11:42:39 user nova-compute[74241]:   </devices>
Oct 20 11:42:39 user nova-compute[74241]: </domain>
Oct 20 11:42:39 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2112730253',display_name='tempest-VolumesActionsTest-instance-2112730253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2112730253',id=22,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f944e9407ab34d048a82723b3fbae0ce',ramdisk_id='',reservation_id='r-llg27358',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-710267249',owner_user_name='tempest-VolumesActionsTest-710267249-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:38Z,user_data=None,user_id='9b107060251349c7b7b598dd92e3dbfa',uuid=a0011656-ed39-48af-a10a-59a4e2305a82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Converting VIF {"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=39a9e83f-4898-4fbb-bb31-8f525be4bf33,network=Network(923e569b-1157-4218-98e2-577a965c7d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a9e83f-48') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG os_vif [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=39a9e83f-4898-4fbb-bb31-8f525be4bf33,network=Network(923e569b-1157-4218-98e2-577a965c7d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a9e83f-48') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cd6ff1c-8b71-5293-b5f7-9c436e02b698', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39a9e83f-48, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39a9e83f-48, col_values=(('qos', UUID('14ac77e2-93da-45d3-b5cc-1fd379680796')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39a9e83f-48, col_values=(('external_ids', {'iface-id': '39a9e83f-4898-4fbb-bb31-8f525be4bf33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:72:a6', 'vm-uuid': 'a0011656-ed39-48af-a10a-59a4e2305a82'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:39 user nova-compute[74241]: INFO os_vif [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=39a9e83f-4898-4fbb-bb31-8f525be4bf33,network=Network(923e569b-1157-4218-98e2-577a965c7d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a9e83f-48')
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] No VIF found with MAC fa:16:3e:bf:72:a6, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.neutron [req-b7c27476-206c-4ba2-8af7-c9714fd2bed2 req-af137a7d-919c-4eed-9436-ff1b9122baea service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Updated VIF entry in instance network info cache for port 39a9e83f-4898-4fbb-bb31-8f525be4bf33. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG nova.network.neutron [req-b7c27476-206c-4ba2-8af7-c9714fd2bed2 req-af137a7d-919c-4eed-9436-ff1b9122baea service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Updating instance_info_cache with network_info: [{"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7c27476-206c-4ba2-8af7-c9714fd2bed2 req-af137a7d-919c-4eed-9436-ff1b9122baea service nova] Releasing lock "refresh_cache-a0011656-ed39-48af-a10a-59a4e2305a82" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:42:40 user nova-compute[74241]: INFO nova.compute.claims [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Claim successful on node user
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:42:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.policy [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab350bf7c74e47b9a941ba537410cdcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79fd876f66c04337973cbc49d1f8cdfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:42:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Creating image(s)
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "/opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "/opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-a829dd8b-7d9e-4f32-832d-9b7f2060ccfc req-3f692b47-5190-4f55-a624-ad722dc8fe28 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received event network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a829dd8b-7d9e-4f32-832d-9b7f2060ccfc req-3f692b47-5190-4f55-a624-ad722dc8fe28 service nova] Acquiring lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a829dd8b-7d9e-4f32-832d-9b7f2060ccfc req-3f692b47-5190-4f55-a624-ad722dc8fe28 service nova] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a829dd8b-7d9e-4f32-832d-9b7f2060ccfc req-3f692b47-5190-4f55-a624-ad722dc8fe28 service nova] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-a829dd8b-7d9e-4f32-832d-9b7f2060ccfc req-3f692b47-5190-4f55-a624-ad722dc8fe28 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] No waiting events found dispatching network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:41 user nova-compute[74241]: WARNING nova.compute.manager [req-a829dd8b-7d9e-4f32-832d-9b7f2060ccfc req-3f692b47-5190-4f55-a624-ad722dc8fe28 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received unexpected event network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 for instance with vm_state building and task_state spawning.
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk 1073741824" returned: 0 in 0.056s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Successfully created port: bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.220s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Cannot resize image /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Ensure instance console log exists: /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Successfully updated port: bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquired lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Updating instance_info_cache with network_info: [{"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Releasing lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Instance network_info: |[{"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Start _get_guest_xml network_info=[{"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:42:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-780403703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-780403703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7804037',id=23,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIR75vWxT4QoRAhS+wEAWVTVdwhMycV1hOsjRMEzODiEeskR0u4mSFOWIbIUonGVJV+PMa87JwMRvUDTiunuJQxazL3KNBhB7msRzKlX+aUXJZajiNowESJI+0O7q7zcA==',key_name='tempest-keypair-137162409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fd876f66c04337973cbc49d1f8cdfa',ramdisk_id='',reservation_id='r-81yk3ol2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-801770068',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab350bf7c74e47b9a941ba537410cdcd',uuid=cf1199a8-5ce6-4778-a8e3-5eb176adde34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Converting VIF {"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:80:65,bridge_name='br-int',has_traffic_filtering=True,id=bfe47f4d-715c-460b-ae2a-b038484d38ff,network=Network(7961c994-a114-441d-b9fc-0063bd856433),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe47f4d-71') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.objects.instance [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lazy-loading 'pci_devices' on Instance uuid cf1199a8-5ce6-4778-a8e3-5eb176adde34 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:42:42 user nova-compute[74241]:   <uuid>cf1199a8-5ce6-4778-a8e3-5eb176adde34</uuid>
Oct 20 11:42:42 user nova-compute[74241]:   <name>instance-00000017</name>
Oct 20 11:42:42 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:42:42 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:42:42 user nova-compute[74241]:   <metadata>
Oct 20 11:42:42 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:42:42 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:42:42 user nova-compute[74241]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-780403703</nova:name>
Oct 20 11:42:42 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:42:42</nova:creationTime>
Oct 20 11:42:42 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:42:42 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:42:42 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:42:42 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:42:42 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:42:42 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:42:42 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:42:42 user nova-compute[74241]:       <nova:owner>
Oct 20 11:42:42 user nova-compute[74241]:         <nova:user uuid="ab350bf7c74e47b9a941ba537410cdcd">tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member</nova:user>
Oct 20 11:42:42 user nova-compute[74241]:         <nova:project uuid="79fd876f66c04337973cbc49d1f8cdfa">tempest-TestServerVolumeAttachScenarioOldVersion-801770068</nova:project>
Oct 20 11:42:42 user nova-compute[74241]:       </nova:owner>
Oct 20 11:42:42 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:42:42 user nova-compute[74241]:       <nova:ports>
Oct 20 11:42:42 user nova-compute[74241]:         <nova:port uuid="bfe47f4d-715c-460b-ae2a-b038484d38ff">
Oct 20 11:42:42 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 11:42:42 user nova-compute[74241]:         </nova:port>
Oct 20 11:42:42 user nova-compute[74241]:       </nova:ports>
Oct 20 11:42:42 user nova-compute[74241]:     </nova:instance>
Oct 20 11:42:42 user nova-compute[74241]:   </metadata>
Oct 20 11:42:42 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:42:42 user nova-compute[74241]:     <system>
Oct 20 11:42:42 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:42:42 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:42:42 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:42:42 user nova-compute[74241]:       <entry name="serial">cf1199a8-5ce6-4778-a8e3-5eb176adde34</entry>
Oct 20 11:42:42 user nova-compute[74241]:       <entry name="uuid">cf1199a8-5ce6-4778-a8e3-5eb176adde34</entry>
Oct 20 11:42:42 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:42:42 user nova-compute[74241]:     </system>
Oct 20 11:42:42 user nova-compute[74241]:   </sysinfo>
Oct 20 11:42:42 user nova-compute[74241]:   <os>
Oct 20 11:42:42 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:42:42 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:42:42 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:42:42 user nova-compute[74241]:   </os>
Oct 20 11:42:42 user nova-compute[74241]:   <features>
Oct 20 11:42:42 user nova-compute[74241]:     <acpi/>
Oct 20 11:42:42 user nova-compute[74241]:     <apic/>
Oct 20 11:42:42 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:42:42 user nova-compute[74241]:   </features>
Oct 20 11:42:42 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:42:42 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:42:42 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:42:42 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:42:42 user nova-compute[74241]:   </clock>
Oct 20 11:42:42 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:42:42 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:42:42 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:42:42 user nova-compute[74241]:   </cpu>
Oct 20 11:42:42 user nova-compute[74241]:   <devices>
Oct 20 11:42:42 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:42:42 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:42:42 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk"/>
Oct 20 11:42:42 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:42:42 user nova-compute[74241]:     </disk>
Oct 20 11:42:42 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:42:42 user nova-compute[74241]:       <mac address="fa:16:3e:ea:80:65"/>
Oct 20 11:42:42 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:42 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:42:42 user nova-compute[74241]:       <target dev="tapbfe47f4d-71"/>
Oct 20 11:42:42 user nova-compute[74241]:     </interface>
Oct 20 11:42:42 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:42:42 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/console.log" append="off"/>
Oct 20 11:42:42 user nova-compute[74241]:     </serial>
Oct 20 11:42:42 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:42:42 user nova-compute[74241]:     <video>
Oct 20 11:42:42 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:42:42 user nova-compute[74241]:     </video>
Oct 20 11:42:42 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:42:42 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:42:42 user nova-compute[74241]:     </rng>
Oct 20 11:42:42 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:42:42 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:42:42 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:42:42 user nova-compute[74241]:     </memballoon>
Oct 20 11:42:42 user nova-compute[74241]:   </devices>
Oct 20 11:42:42 user nova-compute[74241]: </domain>
Oct 20 11:42:42 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-780403703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-780403703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7804037',id=23,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIR75vWxT4QoRAhS+wEAWVTVdwhMycV1hOsjRMEzODiEeskR0u4mSFOWIbIUonGVJV+PMa87JwMRvUDTiunuJQxazL3KNBhB7msRzKlX+aUXJZajiNowESJI+0O7q7zcA==',key_name='tempest-keypair-137162409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79fd876f66c04337973cbc49d1f8cdfa',ramdisk_id='',reservation_id='r-81yk3ol2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-801770068',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab350bf7c74e47b9a941ba537410cdcd',uuid=cf1199a8-5ce6-4778-a8e3-5eb176adde34,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Converting VIF {"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:80:65,bridge_name='br-int',has_traffic_filtering=True,id=bfe47f4d-715c-460b-ae2a-b038484d38ff,network=Network(7961c994-a114-441d-b9fc-0063bd856433),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe47f4d-71') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG os_vif [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:80:65,bridge_name='br-int',has_traffic_filtering=True,id=bfe47f4d-715c-460b-ae2a-b038484d38ff,network=Network(7961c994-a114-441d-b9fc-0063bd856433),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe47f4d-71') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9c83229-9786-52ea-8791-0d2738eb5169', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfe47f4d-71, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfe47f4d-71, col_values=(('qos', UUID('b5b0f22e-0464-45c0-9181-58cca10ae78c')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfe47f4d-71, col_values=(('external_ids', {'iface-id': 'bfe47f4d-715c-460b-ae2a-b038484d38ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:80:65', 'vm-uuid': 'cf1199a8-5ce6-4778-a8e3-5eb176adde34'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:42 user nova-compute[74241]: INFO os_vif [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:80:65,bridge_name='br-int',has_traffic_filtering=True,id=bfe47f4d-715c-460b-ae2a-b038484d38ff,network=Network(7961c994-a114-441d-b9fc-0063bd856433),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe47f4d-71')
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:42:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] No VIF found with MAC fa:16:3e:ea:80:65, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:42:43 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Instance spawned successfully.
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received event network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] Acquiring lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] No waiting events found dispatching network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:43 user nova-compute[74241]: WARNING nova.compute.manager [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received unexpected event network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 for instance with vm_state building and task_state spawning.
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received event network-changed-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Refreshing instance network info cache due to event network-changed-bfe47f4d-715c-460b-ae2a-b038484d38ff. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] Acquiring lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] Acquired lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Refreshing network info cache for port bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:42:43 user nova-compute[74241]: INFO nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Took 5.50 seconds to spawn the instance on the hypervisor.
Oct 20 11:42:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:42:43 user nova-compute[74241]: INFO nova.compute.manager [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Took 6.38 seconds to build instance.
Oct 20 11:42:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03b2fee5-2d50-4ca2-a2c3-802dd482ead5 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "a0011656-ed39-48af-a10a-59a4e2305a82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.486s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Updated VIF entry in instance network info cache for port bfe47f4d-715c-460b-ae2a-b038484d38ff. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Updating instance_info_cache with network_info: [{"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-99d4d00f-1c31-48fc-bd3f-740bbe107929 req-a3e0f2e2-67cb-4d6d-9279-e00f2137e139 service nova] Releasing lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-10f7335a-a854-4b15-bed2-81620cb2aca8 req-0f621cc4-b128-4f94-89ef-043e3cce9ac7 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received event network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-10f7335a-a854-4b15-bed2-81620cb2aca8 req-0f621cc4-b128-4f94-89ef-043e3cce9ac7 service nova] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-10f7335a-a854-4b15-bed2-81620cb2aca8 req-0f621cc4-b128-4f94-89ef-043e3cce9ac7 service nova] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-10f7335a-a854-4b15-bed2-81620cb2aca8 req-0f621cc4-b128-4f94-89ef-043e3cce9ac7 service nova] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-10f7335a-a854-4b15-bed2-81620cb2aca8 req-0f621cc4-b128-4f94-89ef-043e3cce9ac7 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] No waiting events found dispatching network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:44 user nova-compute[74241]: WARNING nova.compute.manager [req-10f7335a-a854-4b15-bed2-81620cb2aca8 req-0f621cc4-b128-4f94-89ef-043e3cce9ac7 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received unexpected event network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff for instance with vm_state building and task_state spawning.
Oct 20 11:42:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:42:46 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Instance spawned successfully.
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-1639f0d4-3a88-4def-9527-8ff145aefc2f req-d1dbf676-11eb-4e5c-953e-6cf882ef0e10 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received event network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1639f0d4-3a88-4def-9527-8ff145aefc2f req-d1dbf676-11eb-4e5c-953e-6cf882ef0e10 service nova] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1639f0d4-3a88-4def-9527-8ff145aefc2f req-d1dbf676-11eb-4e5c-953e-6cf882ef0e10 service nova] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1639f0d4-3a88-4def-9527-8ff145aefc2f req-d1dbf676-11eb-4e5c-953e-6cf882ef0e10 service nova] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-1639f0d4-3a88-4def-9527-8ff145aefc2f req-d1dbf676-11eb-4e5c-953e-6cf882ef0e10 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] No waiting events found dispatching network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:42:46 user nova-compute[74241]: WARNING nova.compute.manager [req-1639f0d4-3a88-4def-9527-8ff145aefc2f req-d1dbf676-11eb-4e5c-953e-6cf882ef0e10 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received unexpected event network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff for instance with vm_state building and task_state spawning.
Oct 20 11:42:46 user nova-compute[74241]: INFO nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Took 5.70 seconds to spawn the instance on the hypervisor.
Oct 20 11:42:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:42:46 user nova-compute[74241]: INFO nova.compute.manager [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Took 6.60 seconds to build instance.
Oct 20 11:42:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fd47b91f-e0e4-464b-9a89-f857faf2e9a3 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.701s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:50 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c19279cb-daa2-491e-8288-e0f2ce35dc1b is timed out.
Oct 20 11:42:50 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully detached device vdb from instance c19279cb-daa2-491e-8288-e0f2ce35dc1b from the live domain config.
Oct 20 11:42:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jJZEtANr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:42:50 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ee685d-da89-417e-8aaf-a5a00f966127]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:42:50 user nova-compute[74241]: No targets found.
Oct 20 11:42:50 user nova-compute[74241]: iSNS:
Oct 20 11:42:50 user nova-compute[74241]: No targets found.
Oct 20 11:42:50 user nova-compute[74241]: STATIC:
Oct 20 11:42:50 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07
Oct 20 11:42:50 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:42:50 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:42:50 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f
Oct 20 11:42:50 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:42:50 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:42:50 user nova-compute[74241]: FIRMWARE:
Oct 20 11:42:50 user nova-compute[74241]: No targets found.
Oct 20 11:42:50 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:42:50 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:42:50 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dc91a0-15d4-44cb-b7ad-688d8128c8ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2016445e-50d9-4ee1-a82b-c2d52923f9fc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:42:50 user nova-compute[74241]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)
Oct 20 11:42:50 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f (non-flash)
Oct 20 11:42:50 user nova-compute[74241]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)
Oct 20 11:42:50 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f520879e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd79944-29cb-48b7-afc0-ca95562b4db3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f0a998-50d5-454a-bc95-bbc47ba672b2]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[199aaee6-f3a2-4c69-a156-546009cba4c0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b05827b-7d81-4cb2-9926-845113228544]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e71181c-eb18-4f4e-9c54-ee91b1227511]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[46718f8b-3f14-459f-bf4e-374eeff42107]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260]
Oct 20 11:42:50 user nova-compute[74241]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f, portal: 172.16.0.220,3260] successful.
Oct 20 11:42:50 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:42:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daa4dbd3-121d-416b-8070-2e3b8616b91f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1691b2fb-80c0-4797-8289-10ae8e602a5e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== disconnect_volume: return (342ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'flavor' on Instance uuid c19279cb-daa2-491e-8288-e0f2ce35dc1b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:42:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4b6b2dbe-050e-4711-9c7b-6c3c7eaddce8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.056s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7350MB free_disk=25.456764221191406GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance c19279cb-daa2-491e-8288-e0f2ce35dc1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 217655bc-d22a-4c39-9522-29f189a6bb5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5600826e-10a2-4079-bb18-a652aa279f45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 87ba8898-bf7b-4e12-9891-f665fd89134d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance a0011656-ed39-48af-a10a-59a4e2305a82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:42:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:42:58 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:42:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:42:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:42:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updating instance_info_cache with network_info: [{"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-217655bc-d22a-4c39-9522-29f189a6bb5f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:42:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:43:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:05 user nova-compute[74241]: INFO nova.compute.manager [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Detaching volume cbb88370-8b6c-4dea-97a1-53745fb93e07
Oct 20 11:43:05 user nova-compute[74241]: INFO nova.virt.block_device [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Attempting to driver detach volume cbb88370-8b6c-4dea-97a1-53745fb93e07 from mountpoint /dev/vdb
Oct 20 11:43:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Attempting to detach device vdb from instance 217655bc-d22a-4c39-9522-29f189a6bb5f from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:43:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:43:05 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:43:05 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:43:05 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:43:05 user nova-compute[74241]:   <serial>cbb88370-8b6c-4dea-97a1-53745fb93e07</serial>
Oct 20 11:43:05 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:43:05 user nova-compute[74241]: </disk>
Oct 20 11:43:05 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:43:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully detached device vdb from instance 217655bc-d22a-4c39-9522-29f189a6bb5f from the persistent domain config.
Oct 20 11:43:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 217655bc-d22a-4c39-9522-29f189a6bb5f from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:43:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:43:05 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:43:05 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:43:05 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:43:05 user nova-compute[74241]:   <serial>cbb88370-8b6c-4dea-97a1-53745fb93e07</serial>
Oct 20 11:43:05 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:43:05 user nova-compute[74241]: </disk>
Oct 20 11:43:05 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:43:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 217655bc-d22a-4c39-9522-29f189a6bb5f {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:43:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:20 user nova-compute[74241]: INFO nova.compute.manager [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Terminating instance
Oct 20 11:43:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-d021a1cf-aa20-469e-b536-0c646cf65639 req-11adb64a-c6ed-4c44-b2f2-97119cd8e83f service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-unplugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d021a1cf-aa20-469e-b536-0c646cf65639 req-11adb64a-c6ed-4c44-b2f2-97119cd8e83f service nova] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d021a1cf-aa20-469e-b536-0c646cf65639 req-11adb64a-c6ed-4c44-b2f2-97119cd8e83f service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d021a1cf-aa20-469e-b536-0c646cf65639 req-11adb64a-c6ed-4c44-b2f2-97119cd8e83f service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-d021a1cf-aa20-469e-b536-0c646cf65639 req-11adb64a-c6ed-4c44-b2f2-97119cd8e83f service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] No waiting events found dispatching network-vif-unplugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-d021a1cf-aa20-469e-b536-0c646cf65639 req-11adb64a-c6ed-4c44-b2f2-97119cd8e83f service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-unplugged-bca45587-745d-4a9a-82bd-17d504fa1d16 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Instance destroyed successfully.
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.objects.instance [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'resources' on Instance uuid c19279cb-daa2-491e-8288-e0f2ce35dc1b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T11:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-325758242',display_name='tempest-ServerActionsTestOtherA-server-1809989271',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-325758242',id=12,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfdRRJbVskDjUThR/IvsP9b1m3vihpGe7aDy8UUiNypatNlCMWiRW9yckmulY6+ixramzXREUBSZQPfWajqoa/vgaSkHTU6CP3WpmBYFOXyTjhpz8m1yETa+pNT54qdoA==',key_name='tempest-keypair-1196191213',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:40:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-a1kpnac2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:40:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=c19279cb-daa2-491e-8288-e0f2ce35dc1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "bca45587-745d-4a9a-82bd-17d504fa1d16", "address": "fa:16:3e:74:36:99", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbca45587-74", "ovs_interfaceid": "bca45587-745d-4a9a-82bd-17d504fa1d16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG os_vif [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbca45587-74, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5febc725-9b27-494b-bbb6-af4db4ac3c9d) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:21 user nova-compute[74241]: INFO os_vif [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:36:99,bridge_name='br-int',has_traffic_filtering=True,id=bca45587-745d-4a9a-82bd-17d504fa1d16,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbca45587-74')
Oct 20 11:43:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Deleting instance files /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b_del
Oct 20 11:43:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Deletion of /opt/stack/data/nova/instances/c19279cb-daa2-491e-8288-e0f2ce35dc1b_del complete
Oct 20 11:43:21 user nova-compute[74241]: INFO nova.compute.manager [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 11:43:21 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:43:21 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:43:22 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:43:22 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Took 1.06 seconds to deallocate network for instance.
Oct 20 11:43:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:23 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:43:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:43:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-ebc37757-d413-4931-b073-36d55a74083c req-95acfb89-eb46-4982-ab79-fb632348a99a service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ebc37757-d413-4931-b073-36d55a74083c req-95acfb89-eb46-4982-ab79-fb632348a99a service nova] Acquiring lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ebc37757-d413-4931-b073-36d55a74083c req-95acfb89-eb46-4982-ab79-fb632348a99a service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ebc37757-d413-4931-b073-36d55a74083c req-95acfb89-eb46-4982-ab79-fb632348a99a service nova] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-ebc37757-d413-4931-b073-36d55a74083c req-95acfb89-eb46-4982-ab79-fb632348a99a service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] No waiting events found dispatching network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:23 user nova-compute[74241]: WARNING nova.compute.manager [req-ebc37757-d413-4931-b073-36d55a74083c req-95acfb89-eb46-4982-ab79-fb632348a99a service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received unexpected event network-vif-plugged-bca45587-745d-4a9a-82bd-17d504fa1d16 for instance with vm_state deleted and task_state None.
Oct 20 11:43:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-ebc37757-d413-4931-b073-36d55a74083c req-95acfb89-eb46-4982-ab79-fb632348a99a service nova] [instance: c19279cb-daa2-491e-8288-e0f2ce35dc1b] Received event network-vif-deleted-bca45587-745d-4a9a-82bd-17d504fa1d16 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:23 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Deleted allocations for instance c19279cb-daa2-491e-8288-e0f2ce35dc1b
Oct 20 11:43:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-62283046-aa23-469e-84de-3af5183dd81d tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "c19279cb-daa2-491e-8288-e0f2ce35dc1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.664s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lazy-loading 'flavor' on Instance uuid 5600826e-10a2-4079-bb18-a652aa279f45 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:24 user nova-compute[74241]: INFO nova.compute.manager [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Attaching volume afbcfb2c-1df6-496b-919f-a063331dc64c to /dev/vdb
Oct 20 11:43:24 user nova-compute[74241]: DEBUG os_brick.utils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b75267-6c24-46ea-8003-de57a7de0882]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2270ef05-0da3-4acc-92dd-8a39fb5357d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad51df05-c6bf-47f3-af7c-0991cf1cc211]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[87190469-7025-415d-8e09-fa66aa7f6ef4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:43:25 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:43:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1851cb27-a64a-4d70-99a3-3774d84ea879]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG os_brick.utils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:43:25 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating existing volume attachment record: 801e03a5-b43c-41fb-a02c-02b551e2b708 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:43:26 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 217655bc-d22a-4c39-9522-29f189a6bb5f is timed out.
Oct 20 11:43:26 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully detached device vdb from instance 217655bc-d22a-4c39-9522-29f189a6bb5f from the live domain config.
Oct 20 11:43:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODXNyAYr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:43:26 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7150df1-2692-4e55-8134-9eed3de047b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:43:26 user nova-compute[74241]: No targets found.
Oct 20 11:43:26 user nova-compute[74241]: iSNS:
Oct 20 11:43:26 user nova-compute[74241]: No targets found.
Oct 20 11:43:26 user nova-compute[74241]: STATIC:
Oct 20 11:43:26 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07
Oct 20 11:43:26 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:43:26 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:43:26 user nova-compute[74241]: FIRMWARE:
Oct 20 11:43:26 user nova-compute[74241]: No targets found.
Oct 20 11:43:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:43:26 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:43:26 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe2c502-0333-433e-82ef-cd4ea84daf11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019e0fc-e64d-4f6c-94bb-9d1aa414649f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)
Oct 20 11:43:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 (non-flash)
Oct 20 11:43:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52087c7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d557d90-f109-43a1-8b9e-6057bfb3665c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c6fbc-78aa-4e5b-bca8-4e4e76ab8b8c]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[43806f36-6bbf-4008-8f8c-b43bcdd3c3a9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[78649f78-3bf0-4960-a953-edbe0f2bf929]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9587eb78-8723-4a4f-ad5a-714aec139185]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9a9439-5017-4208-9dcf-735dd8a7ff87]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07, portal: 172.16.0.220,3260]
Oct 20 11:43:26 user nova-compute[74241]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07, portal: 172.16.0.220,3260] successful.
Oct 20 11:43:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbb88370-8b6c-4dea-97a1-53745fb93e07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fd7179-3ffd-4152-ad3f-c2741903a66e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== disconnect_volume: return (300ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:43:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:43:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "87ba8898-bf7b-4e12-9891-f665fd89134d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:39 user nova-compute[74241]: INFO nova.compute.manager [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Terminating instance
Oct 20 11:43:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-446ca3a3-18ae-45d3-928d-49b0cf88ee5c req-57751984-560f-45c8-8f3b-45de2191d80b service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received event network-vif-unplugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-446ca3a3-18ae-45d3-928d-49b0cf88ee5c req-57751984-560f-45c8-8f3b-45de2191d80b service nova] Acquiring lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-446ca3a3-18ae-45d3-928d-49b0cf88ee5c req-57751984-560f-45c8-8f3b-45de2191d80b service nova] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-446ca3a3-18ae-45d3-928d-49b0cf88ee5c req-57751984-560f-45c8-8f3b-45de2191d80b service nova] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-446ca3a3-18ae-45d3-928d-49b0cf88ee5c req-57751984-560f-45c8-8f3b-45de2191d80b service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] No waiting events found dispatching network-vif-unplugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-446ca3a3-18ae-45d3-928d-49b0cf88ee5c req-57751984-560f-45c8-8f3b-45de2191d80b service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received event network-vif-unplugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Instance destroyed successfully.
Oct 20 11:43:40 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lazy-loading 'resources' on Instance uuid 87ba8898-bf7b-4e12-9891-f665fd89134d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1426871078',display_name='tempest-ServersNegativeTestJSON-server-1426871078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1426871078',id=18,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:41:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1a3993ce9641a5915b335135b32672',ramdisk_id='',reservation_id='r-m0oego36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-819929623',owner_user_name='tempest-ServersNegativeTestJSON-819929623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:41:58Z,user_data=None,user_id='81bd4a77e2a545ab888a85c2e561ef04',uuid=87ba8898-bf7b-4e12-9891-f665fd89134d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converting VIF {"id": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "address": "fa:16:3e:32:13:9d", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21cdd447-4d", "ovs_interfaceid": "21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:13:9d,bridge_name='br-int',has_traffic_filtering=True,id=21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cdd447-4d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG os_vif [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:13:9d,bridge_name='br-int',has_traffic_filtering=True,id=21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cdd447-4d') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21cdd447-4d, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f893cbf-30d2-4023-9dda-d7951afa225c) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:40 user nova-compute[74241]: INFO os_vif [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:13:9d,bridge_name='br-int',has_traffic_filtering=True,id=21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21cdd447-4d')
Oct 20 11:43:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Deleting instance files /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d_del
Oct 20 11:43:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Deletion of /opt/stack/data/nova/instances/87ba8898-bf7b-4e12-9891-f665fd89134d_del complete
Oct 20 11:43:40 user nova-compute[74241]: INFO nova.compute.manager [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 11:43:40 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:43:40 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Took 0.39 seconds to deallocate network for instance.
Oct 20 11:43:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:41 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Deleted allocations for instance 87ba8898-bf7b-4e12-9891-f665fd89134d
Oct 20 11:43:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f9655cc6-e1b1-4698-b479-612a8e93aa4f tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 217655bc-d22a-4c39-9522-29f189a6bb5f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4861a2d0-231a-48fc-b1a0-12646be89ffa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 36.238s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c335e56-e5df-42a8-b746-c80fdb55127e req-510d78b1-61f5-4dbe-b785-ed7ca44e7be9 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received event network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c335e56-e5df-42a8-b746-c80fdb55127e req-510d78b1-61f5-4dbe-b785-ed7ca44e7be9 service nova] Acquiring lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c335e56-e5df-42a8-b746-c80fdb55127e req-510d78b1-61f5-4dbe-b785-ed7ca44e7be9 service nova] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c335e56-e5df-42a8-b746-c80fdb55127e req-510d78b1-61f5-4dbe-b785-ed7ca44e7be9 service nova] Lock "87ba8898-bf7b-4e12-9891-f665fd89134d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c335e56-e5df-42a8-b746-c80fdb55127e req-510d78b1-61f5-4dbe-b785-ed7ca44e7be9 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] No waiting events found dispatching network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:41 user nova-compute[74241]: WARNING nova.compute.manager [req-3c335e56-e5df-42a8-b746-c80fdb55127e req-510d78b1-61f5-4dbe-b785-ed7ca44e7be9 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received unexpected event network-vif-plugged-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 for instance with vm_state deleted and task_state None.
Oct 20 11:43:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c335e56-e5df-42a8-b746-c80fdb55127e req-510d78b1-61f5-4dbe-b785-ed7ca44e7be9 service nova] [instance: 87ba8898-bf7b-4e12-9891-f665fd89134d] Received event network-vif-deleted-21cdd447-4dbb-4dd9-b0a3-1aecf36b2cd9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:43:42 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:43:42 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:43:42 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d9c80-e5eb-4e86-baae-a0a366dd76d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:43:42 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2aca0a-20ea-4dba-94bb-85ad18d46432]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c] added
Oct 20 11:43:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c8c307-b535-421b-b9c8-3363790e1807]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[575d00f0-5903-4a8c-842a-bc3c55c538f0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGnkeIfA {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGnkeIfA" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecc37a4-778b-4834-ad99-aaf7223a19a2]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EGnkeIfA'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[313e3194-db5c-4526-94fe-9da301f1cec3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a4ee5b-6c97-47be-a72a-116445ce19b5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 11:43:42 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 11:43:42 user nova-compute[74241]:  {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:43:42 user nova-compute[74241]: WARNING os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 11:43:42 user nova-compute[74241]: 
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0d5d9f-d19e-4581-aad1-ca028d9c082b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]
Oct 20 11:43:42 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.
Oct 20 11:43:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e25217-84f8-4bd5-a20d-923ed0b1c448]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec86f847-7afc-4f97-8d71-544651331add]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:43:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:43:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c500c4cf-6a8a-42cc-9814-9d846c437e84]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 11:43:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 11:43:43 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:43:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:43:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:43:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23030303036326130', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:43:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030303036326130', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:43:43 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lazy-loading 'flavor' on Instance uuid 5600826e-10a2-4079-bb18-a652aa279f45 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:43:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:43:43 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:43:43 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:43:43 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:43:43 user nova-compute[74241]:   <serial>afbcfb2c-1df6-496b-919f-a063331dc64c</serial>
Oct 20 11:43:43 user nova-compute[74241]: </disk>
Oct 20 11:43:43 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:43:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:43:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:43:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] No VIF found with MAC fa:16:3e:64:d9:51, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:43:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7799bde2-a5da-4709-9da2-ff7ce184f695 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.303s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Stashing vm_state: active {{(pid=74241) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:43:47 user nova-compute[74241]: INFO nova.compute.claims [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Claim successful on node user
Oct 20 11:43:47 user nova-compute[74241]: INFO nova.compute.resource_tracker [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating resource usage from migration 58075315-7dac-4059-ba4d-3007bdfa2624
Oct 20 11:43:47 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.407s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:47 user nova-compute[74241]: INFO nova.compute.manager [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Migrating
Oct 20 11:43:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:43:47 user nova-compute[74241]: INFO nova.compute.rpcapi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 20 11:43:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquired lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:43:47 user nova-compute[74241]: DEBUG nova.network.neutron [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG nova.network.neutron [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Releasing lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Starting migrate_disk_and_power_off {{(pid=74241) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-22069b36-ab29-40d5-bb18-2186e0c4068f req-329f52bf-9f7e-4d3c-8bc8-5579c45307ac service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22069b36-ab29-40d5-bb18-2186e0c4068f req-329f52bf-9f7e-4d3c-8bc8-5579c45307ac service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22069b36-ab29-40d5-bb18-2186e0c4068f req-329f52bf-9f7e-4d3c-8bc8-5579c45307ac service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22069b36-ab29-40d5-bb18-2186e0c4068f req-329f52bf-9f7e-4d3c-8bc8-5579c45307ac service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-22069b36-ab29-40d5-bb18-2186e0c4068f req-329f52bf-9f7e-4d3c-8bc8-5579c45307ac service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:48 user nova-compute[74241]: WARNING nova.compute.manager [req-22069b36-ab29-40d5-bb18-2186e0c4068f req-329f52bf-9f7e-4d3c-8bc8-5579c45307ac service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state active and task_state resize_migrating.
Oct 20 11:43:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance destroyed successfully.
Oct 20 11:43:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:40:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1885854201-network", "vif_mac": "fa:16:3e:64:d9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1885854201-network", "vif_mac": "fa:16:3e:64:d9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG os_vif [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap057c0964-58, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dec757e6-990b-465a-9d7e-5afcd0a4c56e) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:43:48 user nova-compute[74241]: INFO os_vif [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58')
Oct 20 11:43:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:43:49 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7b1944-53b1-455b-87d7-d09f6393e915]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:43:49 user nova-compute[74241]: No targets found.
Oct 20 11:43:49 user nova-compute[74241]: iSNS:
Oct 20 11:43:49 user nova-compute[74241]: No targets found.
Oct 20 11:43:49 user nova-compute[74241]: STATIC:
Oct 20 11:43:49 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c
Oct 20 11:43:49 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:43:49 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:43:49 user nova-compute[74241]: FIRMWARE:
Oct 20 11:43:49 user nova-compute[74241]: No targets found.
Oct 20 11:43:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:43:49 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:43:49 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4a89a2-93f5-4afa-b796-c3763f10efc1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb15f6-000f-413f-9f81-ac8e65454c1c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:43:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:43:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f522847b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[be816ce1-84e5-4b05-b954-1c9f22a50af2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8a5a49-4cbb-43c7-ac12-b86e8248e4bd]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62ec693-386f-444c-9474-f7508678e3c8]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d15a520-62cc-453f-a884-357316757dce]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[778c1415-e476-48e4-8ef5-597701c90f5b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c521f7-1362-4ab0-b9fd-1ee1b9562109]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]
Oct 20 11:43:49 user nova-compute[74241]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.
Oct 20 11:43:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[737d8126-7511-4804-894c-fc1d76ef4d5c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== disconnect_volume: return (288ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:43:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45_resize/disk /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "cp -r /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45_resize/disk /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk" returned: 0 in 0.380s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45_resize/disk.info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk.info {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "cp -r /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45_resize/disk.info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk.info" returned: 0 in 0.033s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-e435cf50-a220-40ab-816b-330501654f09 req-c70cbfab-abc9-4787-9912-93c2f25468fc service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e435cf50-a220-40ab-816b-330501654f09 req-c70cbfab-abc9-4787-9912-93c2f25468fc service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e435cf50-a220-40ab-816b-330501654f09 req-c70cbfab-abc9-4787-9912-93c2f25468fc service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e435cf50-a220-40ab-816b-330501654f09 req-c70cbfab-abc9-4787-9912-93c2f25468fc service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-e435cf50-a220-40ab-816b-330501654f09 req-c70cbfab-abc9-4787-9912-93c2f25468fc service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:50 user nova-compute[74241]: WARNING nova.compute.manager [req-e435cf50-a220-40ab-816b-330501654f09 req-c70cbfab-abc9-4787-9912-93c2f25468fc service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state active and task_state resize_migrating.
Oct 20 11:43:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Port 057c0964-5838-4c58-84aa-e479c46f8835 binding to destination host user is already ACTIVE {{(pid=74241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquired lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Releasing lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG os_brick.utils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385364d-7a8c-4057-a10a-e158e4077dcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ba325-de0d-4ab6-8374-6a55717db731]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cf063b-da54-47a5-872b-94acb85aaa07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b17499-b6d4-4f52-b301-ad03d8f6da42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:43:51 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:43:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6434725-074d-4557-af55-cab052a73a12]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:43:51 user nova-compute[74241]: DEBUG os_brick.utils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:43:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:55 user nova-compute[74241]: INFO nova.compute.manager [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Terminating instance
Oct 20 11:43:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-fa586768-84c8-4445-a62c-98c7f2b642e8 req-9b4abb84-8907-447a-9e9a-7c1ed0e56681 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-unplugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fa586768-84c8-4445-a62c-98c7f2b642e8 req-9b4abb84-8907-447a-9e9a-7c1ed0e56681 service nova] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fa586768-84c8-4445-a62c-98c7f2b642e8 req-9b4abb84-8907-447a-9e9a-7c1ed0e56681 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fa586768-84c8-4445-a62c-98c7f2b642e8 req-9b4abb84-8907-447a-9e9a-7c1ed0e56681 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-fa586768-84c8-4445-a62c-98c7f2b642e8 req-9b4abb84-8907-447a-9e9a-7c1ed0e56681 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] No waiting events found dispatching network-vif-unplugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-fa586768-84c8-4445-a62c-98c7f2b642e8 req-9b4abb84-8907-447a-9e9a-7c1ed0e56681 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-unplugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Instance destroyed successfully.
Oct 20 11:43:56 user nova-compute[74241]: DEBUG nova.objects.instance [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'resources' on Instance uuid 217655bc-d22a-4c39-9522-29f189a6bb5f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:37:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1743344228',display_name='tempest-AttachVolumeNegativeTest-server-1743344228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1743344228',id=14,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHixfmrxpuw7SOqTCQhnXyOFgdC9VGSeavnBkOp24o5mz+VfG33RJJqiMijZL4dMlcGy1Y3ZApnH34YUHDQSONKgogkXqQfx3WljL/aoDBD26xRk+JrF/DHIMr9GeYj1ug==',key_name='tempest-keypair-1782338047',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:38:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-ujbjq7l4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:38:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=217655bc-d22a-4c39-9522-29f189a6bb5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "address": "fa:16:3e:f4:ad:64", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6456d2-60", "ovs_interfaceid": "4e6456d2-605c-4ddb-a205-06de64ae7c77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ad:64,bridge_name='br-int',has_traffic_filtering=True,id=4e6456d2-605c-4ddb-a205-06de64ae7c77,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6456d2-60') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG os_vif [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ad:64,bridge_name='br-int',has_traffic_filtering=True,id=4e6456d2-605c-4ddb-a205-06de64ae7c77,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6456d2-60') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e6456d2-60, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0baf191e-714a-4af0-85bd-2e1f90e5d532) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:43:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:56 user nova-compute[74241]: INFO os_vif [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:ad:64,bridge_name='br-int',has_traffic_filtering=True,id=4e6456d2-605c-4ddb-a205-06de64ae7c77,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6456d2-60')
Oct 20 11:43:56 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Deleting instance files /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f_del
Oct 20 11:43:56 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Deletion of /opt/stack/data/nova/instances/217655bc-d22a-4c39-9522-29f189a6bb5f_del complete
Oct 20 11:43:57 user nova-compute[74241]: INFO nova.compute.manager [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 20 11:43:57 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:43:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:43:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:43:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7660MB free_disk=25.417564392089844GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Applying migration context for instance 5600826e-10a2-4079-bb18-a652aa279f45 as it has an incoming, in-progress migration 58075315-7dac-4059-ba4d-3007bdfa2624. Migration status is post-migrating {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 11:43:57 user nova-compute[74241]: INFO nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating resource usage from migration 58075315-7dac-4059-ba4d-3007bdfa2624
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:43:58 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Took 1.04 seconds to deallocate network for instance.
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-747f92a1-7352-4a89-9afa-6baf70b2d31b req-2d485a52-e0ed-4697-bdfa-a95a216f5345 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-deleted-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:58 user nova-compute[74241]: INFO nova.compute.manager [req-747f92a1-7352-4a89-9afa-6baf70b2d31b req-2d485a52-e0ed-4697-bdfa-a95a216f5345 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Neutron deleted interface 4e6456d2-605c-4ddb-a205-06de64ae7c77; detaching it from the instance and deleting it from the info cache
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.network.neutron [req-747f92a1-7352-4a89-9afa-6baf70b2d31b req-2d485a52-e0ed-4697-bdfa-a95a216f5345 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-747f92a1-7352-4a89-9afa-6baf70b2d31b req-2d485a52-e0ed-4697-bdfa-a95a216f5345 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Detach interface failed, port_id=4e6456d2-605c-4ddb-a205-06de64ae7c77, reason: Instance 217655bc-d22a-4c39-9522-29f189a6bb5f could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 217655bc-d22a-4c39-9522-29f189a6bb5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance a0011656-ed39-48af-a10a-59a4e2305a82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Migration 58075315-7dac-4059-ba4d-3007bdfa2624 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5600826e-10a2-4079-bb18-a652aa279f45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] No waiting events found dispatching network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:58 user nova-compute[74241]: WARNING nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received unexpected event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 for instance with vm_state deleted and task_state None.
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] No waiting events found dispatching network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:58 user nova-compute[74241]: WARNING nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received unexpected event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 for instance with vm_state deleted and task_state None.
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] No waiting events found dispatching network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:58 user nova-compute[74241]: WARNING nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received unexpected event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 for instance with vm_state deleted and task_state None.
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-unplugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] No waiting events found dispatching network-vif-unplugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:58 user nova-compute[74241]: WARNING nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received unexpected event network-vif-unplugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 for instance with vm_state deleted and task_state None.
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Acquiring lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] No waiting events found dispatching network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:43:58 user nova-compute[74241]: WARNING nova.compute.manager [req-6e77993c-c4f1-48e4-8ec1-ccd57a08ba77 req-9e7b9c3b-1455-4909-b2f1-10b7738272f1 service nova] [instance: 217655bc-d22a-4c39-9522-29f189a6bb5f] Received unexpected event network-vif-plugged-4e6456d2-605c-4ddb-a205-06de64ae7c77 for instance with vm_state deleted and task_state None.
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.854s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.570s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:43:58 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:59 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Deleted allocations for instance 217655bc-d22a-4c39-9522-29f189a6bb5f
Oct 20 11:43:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ce314db7-2f16-40e9-9c0b-3d881fab95bf tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "217655bc-d22a-4c39-9522-29f189a6bb5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.214s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:43:59 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid f289e23f-cab7-4631-9c80-6b0391bbea89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:00 user nova-compute[74241]: INFO nova.compute.manager [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Rescuing
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquired lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updating instance_info_cache with network_info: [{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Releasing lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-0cb06e3c-65ab-48cc-8fbd-7a5102a3c9f9 req-270a8e60-4750-4d5c-ab20-e3935897b8f6 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-changed-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-0cb06e3c-65ab-48cc-8fbd-7a5102a3c9f9 req-270a8e60-4750-4d5c-ab20-e3935897b8f6 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Refreshing instance network info cache due to event network-changed-d970e2bd-a050-4038-afec-cb86392153c9. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0cb06e3c-65ab-48cc-8fbd-7a5102a3c9f9 req-270a8e60-4750-4d5c-ab20-e3935897b8f6 service nova] Acquiring lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0cb06e3c-65ab-48cc-8fbd-7a5102a3c9f9 req-270a8e60-4750-4d5c-ab20-e3935897b8f6 service nova] Acquired lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:44:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-0cb06e3c-65ab-48cc-8fbd-7a5102a3c9f9 req-270a8e60-4750-4d5c-ab20-e3935897b8f6 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Refreshing network info cache for port d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-93f48fbb-470e-401b-83e1-9dda46d91da9 req-15b2b2d7-0565-4fd3-982b-6c2a9d37d047 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-unplugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93f48fbb-470e-401b-83e1-9dda46d91da9 req-15b2b2d7-0565-4fd3-982b-6c2a9d37d047 service nova] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93f48fbb-470e-401b-83e1-9dda46d91da9 req-15b2b2d7-0565-4fd3-982b-6c2a9d37d047 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93f48fbb-470e-401b-83e1-9dda46d91da9 req-15b2b2d7-0565-4fd3-982b-6c2a9d37d047 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-93f48fbb-470e-401b-83e1-9dda46d91da9 req-15b2b2d7-0565-4fd3-982b-6c2a9d37d047 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] No waiting events found dispatching network-vif-unplugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:01 user nova-compute[74241]: WARNING nova.compute.manager [req-93f48fbb-470e-401b-83e1-9dda46d91da9 req-15b2b2d7-0565-4fd3-982b-6c2a9d37d047 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received unexpected event network-vif-unplugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b for instance with vm_state active and task_state rescuing.
Oct 20 11:44:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-0cb06e3c-65ab-48cc-8fbd-7a5102a3c9f9 req-270a8e60-4750-4d5c-ab20-e3935897b8f6 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updated VIF entry in instance network info cache for port d970e2bd-a050-4038-afec-cb86392153c9. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-0cb06e3c-65ab-48cc-8fbd-7a5102a3c9f9 req-270a8e60-4750-4d5c-ab20-e3935897b8f6 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating instance_info_cache with network_info: [{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0cb06e3c-65ab-48cc-8fbd-7a5102a3c9f9 req-270a8e60-4750-4d5c-ab20-e3935897b8f6 service nova] Releasing lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:01 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Instance destroyed successfully.
Oct 20 11:44:01 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Attempting rescue
Oct 20 11:44:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Instance directory exists: not creating {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 11:44:01 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Creating image(s)
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'trusted_certs' on Instance uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue" returned: 0 in 0.050s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'migration_context' on Instance uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.base [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<b7db09b0-7889-4436-ba6a-6ed1a544c2b5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Start _get_guest_xml network_info=[{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:14:f2:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'resources' on Instance uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.base [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<b7db09b0-7889-4436-ba6a-6ed1a544c2b5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'numa_topology' on Instance uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.base [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<b7db09b0-7889-4436-ba6a-6ed1a544c2b5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:44:02 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:44:02 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:44:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'vcpu_model' on Instance uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.base [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<b7db09b0-7889-4436-ba6a-6ed1a544c2b5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1970612555',display_name='tempest-ServerRescueNegativeTestJSON-server-1970612555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1970612555',id=21,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-gw13birt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:22Z,user_data=None,user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=b7db09b0-7889-4436-ba6a-6ed1a544c2b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:14:f2:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:14:f2:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:f2:85,bridge_name='br-int',has_traffic_filtering=True,id=204f624b-c2b4-4e64-a2dd-23970b13fb6b,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204f624b-c2') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'pci_devices' on Instance uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.objects.base [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<b7db09b0-7889-4436-ba6a-6ed1a544c2b5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:44:02 user nova-compute[74241]:   <uuid>b7db09b0-7889-4436-ba6a-6ed1a544c2b5</uuid>
Oct 20 11:44:02 user nova-compute[74241]:   <name>instance-00000015</name>
Oct 20 11:44:02 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:44:02 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:44:02 user nova-compute[74241]:   <metadata>
Oct 20 11:44:02 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:44:02 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:44:02 user nova-compute[74241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1970612555</nova:name>
Oct 20 11:44:02 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:44:02</nova:creationTime>
Oct 20 11:44:02 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:44:02 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:44:02 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:44:02 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:44:02 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:44:02 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:44:02 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:44:02 user nova-compute[74241]:       <nova:owner>
Oct 20 11:44:02 user nova-compute[74241]:         <nova:user uuid="6ad19e5d57684ea2ae450fcc53ca8bd7">tempest-ServerRescueNegativeTestJSON-1505666936-project-member</nova:user>
Oct 20 11:44:02 user nova-compute[74241]:         <nova:project uuid="6b379f1e29f94071a26728bdb59bbfcb">tempest-ServerRescueNegativeTestJSON-1505666936</nova:project>
Oct 20 11:44:02 user nova-compute[74241]:       </nova:owner>
Oct 20 11:44:02 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:44:02 user nova-compute[74241]:       <nova:ports>
Oct 20 11:44:02 user nova-compute[74241]:         <nova:port uuid="204f624b-c2b4-4e64-a2dd-23970b13fb6b">
Oct 20 11:44:02 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 11:44:02 user nova-compute[74241]:         </nova:port>
Oct 20 11:44:02 user nova-compute[74241]:       </nova:ports>
Oct 20 11:44:02 user nova-compute[74241]:     </nova:instance>
Oct 20 11:44:02 user nova-compute[74241]:   </metadata>
Oct 20 11:44:02 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:44:02 user nova-compute[74241]:     <system>
Oct 20 11:44:02 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:44:02 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:44:02 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:44:02 user nova-compute[74241]:       <entry name="serial">b7db09b0-7889-4436-ba6a-6ed1a544c2b5</entry>
Oct 20 11:44:02 user nova-compute[74241]:       <entry name="uuid">b7db09b0-7889-4436-ba6a-6ed1a544c2b5</entry>
Oct 20 11:44:02 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:44:02 user nova-compute[74241]:     </system>
Oct 20 11:44:02 user nova-compute[74241]:   </sysinfo>
Oct 20 11:44:02 user nova-compute[74241]:   <os>
Oct 20 11:44:02 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:44:02 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:44:02 user nova-compute[74241]:   </os>
Oct 20 11:44:02 user nova-compute[74241]:   <features>
Oct 20 11:44:02 user nova-compute[74241]:     <acpi/>
Oct 20 11:44:02 user nova-compute[74241]:     <apic/>
Oct 20 11:44:02 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:44:02 user nova-compute[74241]:   </features>
Oct 20 11:44:02 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:44:02 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:44:02 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:44:02 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:44:02 user nova-compute[74241]:   </clock>
Oct 20 11:44:02 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:44:02 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:44:02 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:44:02 user nova-compute[74241]:   </cpu>
Oct 20 11:44:02 user nova-compute[74241]:   <devices>
Oct 20 11:44:02 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:44:02 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:44:02 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue"/>
Oct 20 11:44:02 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:44:02 user nova-compute[74241]:     </disk>
Oct 20 11:44:02 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:44:02 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:44:02 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk"/>
Oct 20 11:44:02 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:44:02 user nova-compute[74241]:     </disk>
Oct 20 11:44:02 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:44:02 user nova-compute[74241]:       <mac address="fa:16:3e:14:f2:85"/>
Oct 20 11:44:02 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:44:02 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:44:02 user nova-compute[74241]:       <target dev="tap204f624b-c2"/>
Oct 20 11:44:02 user nova-compute[74241]:     </interface>
Oct 20 11:44:02 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:44:02 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/console.log" append="off"/>
Oct 20 11:44:02 user nova-compute[74241]:     </serial>
Oct 20 11:44:02 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:44:02 user nova-compute[74241]:     <video>
Oct 20 11:44:02 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:44:02 user nova-compute[74241]:     </video>
Oct 20 11:44:02 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:44:02 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:44:02 user nova-compute[74241]:     </rng>
Oct 20 11:44:02 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:44:02 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:44:02 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:44:02 user nova-compute[74241]:     </memballoon>
Oct 20 11:44:02 user nova-compute[74241]:   </devices>
Oct 20 11:44:02 user nova-compute[74241]: </domain>
Oct 20 11:44:02 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:44:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Instance destroyed successfully.
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No VIF found with MAC fa:16:3e:14:f2:85, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:44:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-6d74aeb5-2909-485b-b0af-8d3dcf5ba63b req-a6cb799e-19c5-46a6-8c97-4f14ced264bf service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6d74aeb5-2909-485b-b0af-8d3dcf5ba63b req-a6cb799e-19c5-46a6-8c97-4f14ced264bf service nova] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6d74aeb5-2909-485b-b0af-8d3dcf5ba63b req-a6cb799e-19c5-46a6-8c97-4f14ced264bf service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6d74aeb5-2909-485b-b0af-8d3dcf5ba63b req-a6cb799e-19c5-46a6-8c97-4f14ced264bf service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-6d74aeb5-2909-485b-b0af-8d3dcf5ba63b req-a6cb799e-19c5-46a6-8c97-4f14ced264bf service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] No waiting events found dispatching network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:03 user nova-compute[74241]: WARNING nova.compute.manager [req-6d74aeb5-2909-485b-b0af-8d3dcf5ba63b req-a6cb799e-19c5-46a6-8c97-4f14ced264bf service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received unexpected event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b for instance with vm_state active and task_state rescuing.
Oct 20 11:44:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:04 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] No waiting events found dispatching network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:05 user nova-compute[74241]: WARNING nova.compute.manager [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received unexpected event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b for instance with vm_state active and task_state rescuing.
Oct 20 11:44:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] No waiting events found dispatching network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:05 user nova-compute[74241]: WARNING nova.compute.manager [req-51104cd4-4cf4-4165-8618-9d572bf7d596 req-67d13c83-923c-4c73-bd21-80ab9111fbe6 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received unexpected event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b for instance with vm_state active and task_state rescuing.
Oct 20 11:44:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c5a77d0f-34d6-4927-83d5-f41233c5a7d5 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:44:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG nova.objects.instance [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:07 user nova-compute[74241]: INFO nova.compute.manager [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Attaching volume a6a2a855-9804-4cce-ab2a-79a4cbe45293 to /dev/vdb
Oct 20 11:44:07 user nova-compute[74241]: DEBUG os_brick.utils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b4144-6c6e-4bd9-be96-fa3cd48a8e0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[83803aae-7cc3-42d5-a952-5a67068f0a57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cbd693-8230-439b-8860-b2fa1874219d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b878d86-0616-4c4b-9f04-d244907863bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:44:07 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:44:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[935f12d1-f885-415b-b5e7-ef211102c728]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG os_brick.utils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:44:07 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating existing volume attachment record: 6c42e016-8053-476b-b702-84709f2bc4fa {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Starting finish_migration {{(pid=74241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance directory exists: not creating {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 11:44:09 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Creating image(s)
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk. size=21474836480 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk 21474836480 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk 21474836480" returned: 0 in 0.053s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Ensure instance console log exists: /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Start _get_guest_xml network_info=[{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1885854201-network", "vif_mac": "fa:16:3e:64:d9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '13deaeb4-7131-4c68-9c69-5b9536472baf', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5600826e-10a2-4079-bb18-a652aa279f45', 'attached_at': '2023-10-20T11:44:09.000000', 'detached_at': '', 'volume_id': 'afbcfb2c-1df6-496b-919f-a063331dc64c', 'serial': 'afbcfb2c-1df6-496b-919f-a063331dc64c'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:44:09 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:44:09 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:29:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:44:09 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:44:09 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:44:09 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d73980-6ae1-4d58-923b-bb43e9ff70e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:44:09 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[748532f7-81ed-4954-ac7e-65828140aca2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c] added
Oct 20 11:44:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd5b86-f7a8-479c-a821-eb587da8e8d8]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a0ab9-45f0-4917-ae5f-edd7b22bc227]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGnkeIfA {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGnkeIfA" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4dcd15-824b-4eac-905e-7d5a05c1cec3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EGnkeIfA'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2207773-9452-425e-9cdd-76526a9529dc]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1ec2a-39e6-44db-81c1-5ef9958b91c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 11:44:09 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 11:44:09 user nova-compute[74241]:  {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:44:09 user nova-compute[74241]: WARNING os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 11:44:09 user nova-compute[74241]: 
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7c2b7a-cfec-4609-a2b6-d1a831be7d27]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]
Oct 20 11:44:09 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.
Oct 20 11:44:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[839be375-04e0-4b4b-a525-2ad13513fe3b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af21e3e-7e82-41e7-87b3-1a888d1d53d9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:10 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:10 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c2480-3de0-434f-973a-71090c7a7c61]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23030303036326130', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030303036326130', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:40:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1885854201-network", "vif_mac": "fa:16:3e:64:d9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1885854201-network", "vif_mac": "fa:16:3e:64:d9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:44:11 user nova-compute[74241]:   <uuid>5600826e-10a2-4079-bb18-a652aa279f45</uuid>
Oct 20 11:44:11 user nova-compute[74241]:   <name>instance-00000011</name>
Oct 20 11:44:11 user nova-compute[74241]:   <memory>2097152</memory>
Oct 20 11:44:11 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:44:11 user nova-compute[74241]:   <metadata>
Oct 20 11:44:11 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:44:11 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:44:11 user nova-compute[74241]:       <nova:name>tempest-ServerActionsTestOtherB-server-1518638015</nova:name>
Oct 20 11:44:11 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:44:09</nova:creationTime>
Oct 20 11:44:11 user nova-compute[74241]:       <nova:flavor name="m1.small">
Oct 20 11:44:11 user nova-compute[74241]:         <nova:memory>2048</nova:memory>
Oct 20 11:44:11 user nova-compute[74241]:         <nova:disk>20</nova:disk>
Oct 20 11:44:11 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:44:11 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:44:11 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:44:11 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:44:11 user nova-compute[74241]:       <nova:owner>
Oct 20 11:44:11 user nova-compute[74241]:         <nova:user uuid="0195b190e68a42be9877144bfe0cb277">tempest-ServerActionsTestOtherB-805994491-project-member</nova:user>
Oct 20 11:44:11 user nova-compute[74241]:         <nova:project uuid="8956d1d704f54819b417cd6e5c7abd27">tempest-ServerActionsTestOtherB-805994491</nova:project>
Oct 20 11:44:11 user nova-compute[74241]:       </nova:owner>
Oct 20 11:44:11 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:44:11 user nova-compute[74241]:       <nova:ports>
Oct 20 11:44:11 user nova-compute[74241]:         <nova:port uuid="057c0964-5838-4c58-84aa-e479c46f8835">
Oct 20 11:44:11 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 11:44:11 user nova-compute[74241]:         </nova:port>
Oct 20 11:44:11 user nova-compute[74241]:       </nova:ports>
Oct 20 11:44:11 user nova-compute[74241]:     </nova:instance>
Oct 20 11:44:11 user nova-compute[74241]:   </metadata>
Oct 20 11:44:11 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:44:11 user nova-compute[74241]:     <system>
Oct 20 11:44:11 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:44:11 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:44:11 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:44:11 user nova-compute[74241]:       <entry name="serial">5600826e-10a2-4079-bb18-a652aa279f45</entry>
Oct 20 11:44:11 user nova-compute[74241]:       <entry name="uuid">5600826e-10a2-4079-bb18-a652aa279f45</entry>
Oct 20 11:44:11 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:44:11 user nova-compute[74241]:     </system>
Oct 20 11:44:11 user nova-compute[74241]:   </sysinfo>
Oct 20 11:44:11 user nova-compute[74241]:   <os>
Oct 20 11:44:11 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:44:11 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:44:11 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:44:11 user nova-compute[74241]:   </os>
Oct 20 11:44:11 user nova-compute[74241]:   <features>
Oct 20 11:44:11 user nova-compute[74241]:     <acpi/>
Oct 20 11:44:11 user nova-compute[74241]:     <apic/>
Oct 20 11:44:11 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:44:11 user nova-compute[74241]:   </features>
Oct 20 11:44:11 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:44:11 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:44:11 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:44:11 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:44:11 user nova-compute[74241]:   </clock>
Oct 20 11:44:11 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:44:11 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:44:11 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:44:11 user nova-compute[74241]:   </cpu>
Oct 20 11:44:11 user nova-compute[74241]:   <devices>
Oct 20 11:44:11 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:44:11 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:44:11 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk"/>
Oct 20 11:44:11 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:44:11 user nova-compute[74241]:     </disk>
Oct 20 11:44:11 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:44:11 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:44:11 user nova-compute[74241]:       <source dev="/dev/sdb"/>
Oct 20 11:44:11 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:44:11 user nova-compute[74241]:       <serial>afbcfb2c-1df6-496b-919f-a063331dc64c</serial>
Oct 20 11:44:11 user nova-compute[74241]:     </disk>
Oct 20 11:44:11 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:44:11 user nova-compute[74241]:       <mac address="fa:16:3e:64:d9:51"/>
Oct 20 11:44:11 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:44:11 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:44:11 user nova-compute[74241]:       <target dev="tap057c0964-58"/>
Oct 20 11:44:11 user nova-compute[74241]:     </interface>
Oct 20 11:44:11 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:44:11 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/console.log" append="off"/>
Oct 20 11:44:11 user nova-compute[74241]:     </serial>
Oct 20 11:44:11 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:44:11 user nova-compute[74241]:     <video>
Oct 20 11:44:11 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:44:11 user nova-compute[74241]:     </video>
Oct 20 11:44:11 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:44:11 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:44:11 user nova-compute[74241]:     </rng>
Oct 20 11:44:11 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:44:11 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:44:11 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:44:11 user nova-compute[74241]:     </memballoon>
Oct 20 11:44:11 user nova-compute[74241]:   </devices>
Oct 20 11:44:11 user nova-compute[74241]: </domain>
Oct 20 11:44:11 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:40:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:43:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1885854201-network", "vif_mac": "fa:16:3e:64:d9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1885854201-network", "vif_mac": "fa:16:3e:64:d9:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG os_vif [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2731e578-58fd-5bfc-b530-43668eb2a4c3', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap057c0964-58, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap057c0964-58, col_values=(('qos', UUID('b36047e2-dc01-427d-a554-1c1a26bcf11e')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap057c0964-58, col_values=(('external_ids', {'iface-id': '057c0964-5838-4c58-84aa-e479c46f8835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:d9:51', 'vm-uuid': '5600826e-10a2-4079-bb18-a652aa279f45'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:11 user nova-compute[74241]: INFO os_vif [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58')
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] No VIF found with MAC fa:16:3e:64:d9:51, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-4a517450-7c27-441d-9926-840d5587902e req-18ce657e-3f24-4d13-bed4-c0faf4609cbd service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4a517450-7c27-441d-9926-840d5587902e req-18ce657e-3f24-4d13-bed4-c0faf4609cbd service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4a517450-7c27-441d-9926-840d5587902e req-18ce657e-3f24-4d13-bed4-c0faf4609cbd service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4a517450-7c27-441d-9926-840d5587902e req-18ce657e-3f24-4d13-bed4-c0faf4609cbd service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-4a517450-7c27-441d-9926-840d5587902e req-18ce657e-3f24-4d13-bed4-c0faf4609cbd service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:12 user nova-compute[74241]: WARNING nova.compute.manager [req-4a517450-7c27-441d-9926-840d5587902e req-18ce657e-3f24-4d13-bed4-c0faf4609cbd service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state active and task_state resize_finish.
Oct 20 11:44:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-00152ed1-40b1-42c6-a0b4-cfe331299e16 req-241d8e40-2c7d-4d7f-be2e-e601ab798612 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-00152ed1-40b1-42c6-a0b4-cfe331299e16 req-241d8e40-2c7d-4d7f-be2e-e601ab798612 service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-00152ed1-40b1-42c6-a0b4-cfe331299e16 req-241d8e40-2c7d-4d7f-be2e-e601ab798612 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-00152ed1-40b1-42c6-a0b4-cfe331299e16 req-241d8e40-2c7d-4d7f-be2e-e601ab798612 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-00152ed1-40b1-42c6-a0b4-cfe331299e16 req-241d8e40-2c7d-4d7f-be2e-e601ab798612 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:14 user nova-compute[74241]: WARNING nova.compute.manager [req-00152ed1-40b1-42c6-a0b4-cfe331299e16 req-241d8e40-2c7d-4d7f-be2e-e601ab798612 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state active and task_state resize_finish.
Oct 20 11:44:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:44:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance running successfully.
Oct 20 11:44:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Failed to set time: agent not configured {{(pid=74241) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 11:44:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61cbb3d0-38c0-4a51-8d3d-c75e8e18a394 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] finish_migration finished successfully. {{(pid=74241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 11:44:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuAMeSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:44:25 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:44:25 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:44:25 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1819fc-d0d4-47fb-9a74-113c0d97d111]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:44:25 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2060fdaa-3101-4f96-9878-cf8016b932ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293] added
Oct 20 11:44:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6634e413-6f7b-4bcf-ac41-e8ca241efeed]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e21fd7-ee98-40e4-9090-947772c2632e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuAMeSbi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuAMeSbi" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff0e03f-0f3d-4b12-ac79-43cd9ea3b784]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LuAMeSbi'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05c22a7-9cdf-42ef-85ed-195e541a1998]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c4cfb-02e9-4a48-99c8-18c853733b9d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc77262-edcc-43b6-8813-9fbee37a8399]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260]
Oct 20 11:44:25 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260] successful.
Oct 20 11:44:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39e2c8b-f553-4f5a-a0c8-d7cf6e1f1867]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b426d7f-023d-440e-8a6c-1eabb46e21a8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:25 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:44:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:25 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:44:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c1f4f1-931c-4b54-a65c-385c72d1d38d]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:44:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuAMeSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:44:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:44:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23338323166636666', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:44:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338323166636666', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:44:26 user nova-compute[74241]: DEBUG nova.objects.instance [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:44:26 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:44:26 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:44:26 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:44:26 user nova-compute[74241]:   <serial>a6a2a855-9804-4cce-ab2a-79a4cbe45293</serial>
Oct 20 11:44:26 user nova-compute[74241]: </disk>
Oct 20 11:44:26 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:44:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No VIF found with MAC fa:16:3e:4d:4b:43, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:44:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5fedcd11-0536-42cf-b010-45367367fa33 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.704s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-045b8f95-a3d2-401a-85e5-fe962dffbd41 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-045b8f95-a3d2-401a-85e5-fe962dffbd41 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-045b8f95-a3d2-401a-85e5-fe962dffbd41 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-045b8f95-a3d2-401a-85e5-fe962dffbd41 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74241) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG nova.objects.instance [None req-045b8f95-a3d2-401a-85e5-fe962dffbd41 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-11138282-93a1-43ba-bb9e-81e98666b8b0 req-9c7e3b9a-f621-4b02-abd9-f97da4e66207 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-11138282-93a1-43ba-bb9e-81e98666b8b0 req-9c7e3b9a-f621-4b02-abd9-f97da4e66207 service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-11138282-93a1-43ba-bb9e-81e98666b8b0 req-9c7e3b9a-f621-4b02-abd9-f97da4e66207 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-11138282-93a1-43ba-bb9e-81e98666b8b0 req-9c7e3b9a-f621-4b02-abd9-f97da4e66207 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-11138282-93a1-43ba-bb9e-81e98666b8b0 req-9c7e3b9a-f621-4b02-abd9-f97da4e66207 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:28 user nova-compute[74241]: WARNING nova.compute.manager [req-11138282-93a1-43ba-bb9e-81e98666b8b0 req-9c7e3b9a-f621-4b02-abd9-f97da4e66207 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state active and task_state powering-off.
Oct 20 11:44:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance destroyed successfully.
Oct 20 11:44:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-045b8f95-a3d2-401a-85e5-fe962dffbd41 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:44:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-045b8f95-a3d2-401a-85e5-fe962dffbd41 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.122s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-d54c4003-cd65-4d05-bdc4-deafece39fb7 req-e91f97cc-ca03-410c-8fec-f352552b743b service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d54c4003-cd65-4d05-bdc4-deafece39fb7 req-e91f97cc-ca03-410c-8fec-f352552b743b service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d54c4003-cd65-4d05-bdc4-deafece39fb7 req-e91f97cc-ca03-410c-8fec-f352552b743b service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d54c4003-cd65-4d05-bdc4-deafece39fb7 req-e91f97cc-ca03-410c-8fec-f352552b743b service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-d54c4003-cd65-4d05-bdc4-deafece39fb7 req-e91f97cc-ca03-410c-8fec-f352552b743b service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:30 user nova-compute[74241]: WARNING nova.compute.manager [req-d54c4003-cd65-4d05-bdc4-deafece39fb7 req-e91f97cc-ca03-410c-8fec-f352552b743b service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state stopped and task_state None.
Oct 20 11:44:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-89efe4c2-7144-4d46-8eab-9cca1aed94f7 req-7ce90e5b-9e28-4863-938b-ddecc55348d7 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received event network-changed-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-89efe4c2-7144-4d46-8eab-9cca1aed94f7 req-7ce90e5b-9e28-4863-938b-ddecc55348d7 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Refreshing instance network info cache due to event network-changed-bfe47f4d-715c-460b-ae2a-b038484d38ff. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:44:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-89efe4c2-7144-4d46-8eab-9cca1aed94f7 req-7ce90e5b-9e28-4863-938b-ddecc55348d7 service nova] Acquiring lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:44:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-89efe4c2-7144-4d46-8eab-9cca1aed94f7 req-7ce90e5b-9e28-4863-938b-ddecc55348d7 service nova] Acquired lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:44:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-89efe4c2-7144-4d46-8eab-9cca1aed94f7 req-7ce90e5b-9e28-4863-938b-ddecc55348d7 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Refreshing network info cache for port bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:44:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-89efe4c2-7144-4d46-8eab-9cca1aed94f7 req-7ce90e5b-9e28-4863-938b-ddecc55348d7 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Updated VIF entry in instance network info cache for port bfe47f4d-715c-460b-ae2a-b038484d38ff. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:44:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-89efe4c2-7144-4d46-8eab-9cca1aed94f7 req-7ce90e5b-9e28-4863-938b-ddecc55348d7 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Updating instance_info_cache with network_info: [{"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:44:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-89efe4c2-7144-4d46-8eab-9cca1aed94f7 req-7ce90e5b-9e28-4863-938b-ddecc55348d7 service nova] Releasing lock "refresh_cache-cf1199a8-5ce6-4778-a8e3-5eb176adde34" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:44:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG nova.objects.instance [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lazy-loading 'flavor' on Instance uuid cf1199a8-5ce6-4778-a8e3-5eb176adde34 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:37 user nova-compute[74241]: INFO nova.compute.manager [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Attaching volume fa647bb4-70e4-4ea6-9189-cc43f9d62207 to /dev/vdb
Oct 20 11:44:37 user nova-compute[74241]: DEBUG os_brick.utils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ad7793-f0c9-449e-ac58-f75055348caf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b585b8c7-e9c0-47b2-a550-8dc345593dc1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53015d5-3e01-44cb-b79b-63992040f6ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91d3249-f8d5-4004-a55c-0880da7f689f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:44:37 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:44:37 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e51c187-478f-4f00-a2a2-a01ada24bdf9]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG os_brick.utils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:44:37 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Updating existing volume attachment record: 61758b89-35f6-435c-8a3e-20a3f979c6f8 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:44:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "a0011656-ed39-48af-a10a-59a4e2305a82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "a0011656-ed39-48af-a10a-59a4e2305a82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:43 user nova-compute[74241]: INFO nova.compute.manager [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Terminating instance
Oct 20 11:44:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-4c647fc1-05f8-4ba0-b259-a1c2843fac63 req-f472955f-7cee-497d-805e-3713c13f1e87 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received event network-vif-unplugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4c647fc1-05f8-4ba0-b259-a1c2843fac63 req-f472955f-7cee-497d-805e-3713c13f1e87 service nova] Acquiring lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4c647fc1-05f8-4ba0-b259-a1c2843fac63 req-f472955f-7cee-497d-805e-3713c13f1e87 service nova] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4c647fc1-05f8-4ba0-b259-a1c2843fac63 req-f472955f-7cee-497d-805e-3713c13f1e87 service nova] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-4c647fc1-05f8-4ba0-b259-a1c2843fac63 req-f472955f-7cee-497d-805e-3713c13f1e87 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] No waiting events found dispatching network-vif-unplugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-4c647fc1-05f8-4ba0-b259-a1c2843fac63 req-f472955f-7cee-497d-805e-3713c13f1e87 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received event network-vif-unplugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:44 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Instance destroyed successfully.
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.objects.instance [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lazy-loading 'resources' on Instance uuid a0011656-ed39-48af-a10a-59a4e2305a82 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2112730253',display_name='tempest-VolumesActionsTest-instance-2112730253',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2112730253',id=22,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f944e9407ab34d048a82723b3fbae0ce',ramdisk_id='',reservation_id='r-llg27358',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-710267249',owner_user_name='tempest-VolumesActionsTest-710267249-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:42:43Z,user_data=None,user_id='9b107060251349c7b7b598dd92e3dbfa',uuid=a0011656-ed39-48af-a10a-59a4e2305a82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Converting VIF {"id": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "address": "fa:16:3e:bf:72:a6", "network": {"id": "923e569b-1157-4218-98e2-577a965c7d95", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1204875961-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f944e9407ab34d048a82723b3fbae0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39a9e83f-48", "ovs_interfaceid": "39a9e83f-4898-4fbb-bb31-8f525be4bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=39a9e83f-4898-4fbb-bb31-8f525be4bf33,network=Network(923e569b-1157-4218-98e2-577a965c7d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a9e83f-48') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG os_vif [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=39a9e83f-4898-4fbb-bb31-8f525be4bf33,network=Network(923e569b-1157-4218-98e2-577a965c7d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a9e83f-48') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39a9e83f-48, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14ac77e2-93da-45d3-b5cc-1fd379680796) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:44 user nova-compute[74241]: INFO os_vif [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:a6,bridge_name='br-int',has_traffic_filtering=True,id=39a9e83f-4898-4fbb-bb31-8f525be4bf33,network=Network(923e569b-1157-4218-98e2-577a965c7d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39a9e83f-48')
Oct 20 11:44:44 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Deleting instance files /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82_del
Oct 20 11:44:44 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Deletion of /opt/stack/data/nova/instances/a0011656-ed39-48af-a10a-59a4e2305a82_del complete
Oct 20 11:44:44 user nova-compute[74241]: INFO nova.compute.manager [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Took 0.76 seconds to destroy the instance on the hypervisor.
Oct 20 11:44:44 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:44:44 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Took 0.56 seconds to deallocate network for instance.
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-383f8fd7-e143-40b7-8aac-46064fe7808e req-ffca12c2-1722-41fa-9480-18a2929ebdf0 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received event network-vif-deleted-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:44 user nova-compute[74241]: INFO nova.compute.manager [req-383f8fd7-e143-40b7-8aac-46064fe7808e req-ffca12c2-1722-41fa-9480-18a2929ebdf0 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Neutron deleted interface 39a9e83f-4898-4fbb-bb31-8f525be4bf33; detaching it from the instance and deleting it from the info cache
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-383f8fd7-e143-40b7-8aac-46064fe7808e req-ffca12c2-1722-41fa-9480-18a2929ebdf0 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-383f8fd7-e143-40b7-8aac-46064fe7808e req-ffca12c2-1722-41fa-9480-18a2929ebdf0 service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Detach interface failed, port_id=39a9e83f-4898-4fbb-bb31-8f525be4bf33, reason: Instance a0011656-ed39-48af-a10a-59a4e2305a82 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:45 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:44:45 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:44:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:45 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Deleted allocations for instance a0011656-ed39-48af-a10a-59a4e2305a82
Oct 20 11:44:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-87af9df1-4e38-41d0-ba2f-8efbc19aa956 tempest-VolumesActionsTest-710267249 tempest-VolumesActionsTest-710267249-project-member] Lock "a0011656-ed39-48af-a10a-59a4e2305a82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-7cec91a8-9040-4201-b964-6d7bd4ee7b79 req-2e0115da-c56c-4406-b0a8-72ce5ad4774a service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received event network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7cec91a8-9040-4201-b964-6d7bd4ee7b79 req-2e0115da-c56c-4406-b0a8-72ce5ad4774a service nova] Acquiring lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7cec91a8-9040-4201-b964-6d7bd4ee7b79 req-2e0115da-c56c-4406-b0a8-72ce5ad4774a service nova] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7cec91a8-9040-4201-b964-6d7bd4ee7b79 req-2e0115da-c56c-4406-b0a8-72ce5ad4774a service nova] Lock "a0011656-ed39-48af-a10a-59a4e2305a82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-7cec91a8-9040-4201-b964-6d7bd4ee7b79 req-2e0115da-c56c-4406-b0a8-72ce5ad4774a service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] No waiting events found dispatching network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:45 user nova-compute[74241]: WARNING nova.compute.manager [req-7cec91a8-9040-4201-b964-6d7bd4ee7b79 req-2e0115da-c56c-4406-b0a8-72ce5ad4774a service nova] [instance: a0011656-ed39-48af-a10a-59a4e2305a82] Received unexpected event network-vif-plugged-39a9e83f-4898-4fbb-bb31-8f525be4bf33 for instance with vm_state deleted and task_state None.
Oct 20 11:44:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:44:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:49 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:44:49 user nova-compute[74241]: INFO nova.compute.claims [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Claim successful on node user
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:44:50 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.policy [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3637bc89e77c475ba2fc72002d61b5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce95d8752f04f25a15f0673b063d405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:44:50 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Creating image(s)
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "/opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "/opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk 1073741824" returned: 0 in 0.048s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:50 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Successfully created port: 91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Cannot resize image /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Ensure instance console log exists: /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Successfully updated port: 91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquired lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-ac7dee4b-9779-4c2e-9d4b-0a831f65489f req-0de238c4-3df3-46d7-b322-61ec17ec6d6b service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received event network-changed-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-ac7dee4b-9779-4c2e-9d4b-0a831f65489f req-0de238c4-3df3-46d7-b322-61ec17ec6d6b service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Refreshing instance network info cache due to event network-changed-91c8f08e-494c-469d-8dd8-5d5a387b8534. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ac7dee4b-9779-4c2e-9d4b-0a831f65489f req-0de238c4-3df3-46d7-b322-61ec17ec6d6b service nova] Acquiring lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:44:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Updating instance_info_cache with network_info: [{"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Releasing lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Instance network_info: |[{"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ac7dee4b-9779-4c2e-9d4b-0a831f65489f req-0de238c4-3df3-46d7-b322-61ec17ec6d6b service nova] Acquired lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-ac7dee4b-9779-4c2e-9d4b-0a831f65489f req-0de238c4-3df3-46d7-b322-61ec17ec6d6b service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Refreshing network info cache for port 91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Start _get_guest_xml network_info=[{"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:44:52 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:44:52 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:44:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1105658303',display_name='tempest-AttachVolumeNegativeTest-server-1105658303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1105658303',id=24,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs78lmk/fApLiOBy8wHY4Jb8USFKuymoiPVtqRELD/+x0ybYYuIzN/3s2dqyZYxVKaVbqTkOIUTUSubLvDBrcc+PhU3eVMiFc1fHXH9QS0GWg08FaieGqBs5OzgUgkN8w==',key_name='tempest-keypair-1678933620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-0a7d0qiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=7d253e72-22d1-4bf2-be00-69c298bfe1d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=91c8f08e-494c-469d-8dd8-5d5a387b8534,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c8f08e-49') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d253e72-22d1-4bf2-be00-69c298bfe1d3 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:44:52 user nova-compute[74241]:   <uuid>7d253e72-22d1-4bf2-be00-69c298bfe1d3</uuid>
Oct 20 11:44:52 user nova-compute[74241]:   <name>instance-00000018</name>
Oct 20 11:44:52 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:44:52 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:44:52 user nova-compute[74241]:   <metadata>
Oct 20 11:44:52 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:44:52 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:44:52 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1105658303</nova:name>
Oct 20 11:44:52 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:44:52</nova:creationTime>
Oct 20 11:44:52 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:44:52 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:44:52 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:44:52 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:44:52 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:44:52 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:44:52 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:44:52 user nova-compute[74241]:       <nova:owner>
Oct 20 11:44:52 user nova-compute[74241]:         <nova:user uuid="3637bc89e77c475ba2fc72002d61b5c2">tempest-AttachVolumeNegativeTest-252317716-project-member</nova:user>
Oct 20 11:44:52 user nova-compute[74241]:         <nova:project uuid="4ce95d8752f04f25a15f0673b063d405">tempest-AttachVolumeNegativeTest-252317716</nova:project>
Oct 20 11:44:52 user nova-compute[74241]:       </nova:owner>
Oct 20 11:44:52 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:44:52 user nova-compute[74241]:       <nova:ports>
Oct 20 11:44:52 user nova-compute[74241]:         <nova:port uuid="91c8f08e-494c-469d-8dd8-5d5a387b8534">
Oct 20 11:44:52 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 11:44:52 user nova-compute[74241]:         </nova:port>
Oct 20 11:44:52 user nova-compute[74241]:       </nova:ports>
Oct 20 11:44:52 user nova-compute[74241]:     </nova:instance>
Oct 20 11:44:52 user nova-compute[74241]:   </metadata>
Oct 20 11:44:52 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:44:52 user nova-compute[74241]:     <system>
Oct 20 11:44:52 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:44:52 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:44:52 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:44:52 user nova-compute[74241]:       <entry name="serial">7d253e72-22d1-4bf2-be00-69c298bfe1d3</entry>
Oct 20 11:44:52 user nova-compute[74241]:       <entry name="uuid">7d253e72-22d1-4bf2-be00-69c298bfe1d3</entry>
Oct 20 11:44:52 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:44:52 user nova-compute[74241]:     </system>
Oct 20 11:44:52 user nova-compute[74241]:   </sysinfo>
Oct 20 11:44:52 user nova-compute[74241]:   <os>
Oct 20 11:44:52 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:44:52 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:44:52 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:44:52 user nova-compute[74241]:   </os>
Oct 20 11:44:52 user nova-compute[74241]:   <features>
Oct 20 11:44:52 user nova-compute[74241]:     <acpi/>
Oct 20 11:44:52 user nova-compute[74241]:     <apic/>
Oct 20 11:44:52 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:44:52 user nova-compute[74241]:   </features>
Oct 20 11:44:52 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:44:52 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:44:52 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:44:52 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:44:52 user nova-compute[74241]:   </clock>
Oct 20 11:44:52 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:44:52 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:44:52 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:44:52 user nova-compute[74241]:   </cpu>
Oct 20 11:44:52 user nova-compute[74241]:   <devices>
Oct 20 11:44:52 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:44:52 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:44:52 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk"/>
Oct 20 11:44:52 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:44:52 user nova-compute[74241]:     </disk>
Oct 20 11:44:52 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:44:52 user nova-compute[74241]:       <mac address="fa:16:3e:ba:0a:91"/>
Oct 20 11:44:52 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:44:52 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:44:52 user nova-compute[74241]:       <target dev="tap91c8f08e-49"/>
Oct 20 11:44:52 user nova-compute[74241]:     </interface>
Oct 20 11:44:52 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:44:52 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/console.log" append="off"/>
Oct 20 11:44:52 user nova-compute[74241]:     </serial>
Oct 20 11:44:52 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:44:52 user nova-compute[74241]:     <video>
Oct 20 11:44:52 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:44:52 user nova-compute[74241]:     </video>
Oct 20 11:44:52 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:44:52 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:44:52 user nova-compute[74241]:     </rng>
Oct 20 11:44:52 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:44:52 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:44:52 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:44:52 user nova-compute[74241]:     </memballoon>
Oct 20 11:44:52 user nova-compute[74241]:   </devices>
Oct 20 11:44:52 user nova-compute[74241]: </domain>
Oct 20 11:44:52 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:44:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1105658303',display_name='tempest-AttachVolumeNegativeTest-server-1105658303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1105658303',id=24,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs78lmk/fApLiOBy8wHY4Jb8USFKuymoiPVtqRELD/+x0ybYYuIzN/3s2dqyZYxVKaVbqTkOIUTUSubLvDBrcc+PhU3eVMiFc1fHXH9QS0GWg08FaieGqBs5OzgUgkN8w==',key_name='tempest-keypair-1678933620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-0a7d0qiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:44:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=7d253e72-22d1-4bf2-be00-69c298bfe1d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=91c8f08e-494c-469d-8dd8-5d5a387b8534,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c8f08e-49') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG os_vif [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=91c8f08e-494c-469d-8dd8-5d5a387b8534,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c8f08e-49') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1628da87-c222-536a-8784-5b6b2fb9548f', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91c8f08e-49, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91c8f08e-49, col_values=(('qos', UUID('91334322-a073-46cd-819d-8fa85daee097')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91c8f08e-49, col_values=(('external_ids', {'iface-id': '91c8f08e-494c-469d-8dd8-5d5a387b8534', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:0a:91', 'vm-uuid': '7d253e72-22d1-4bf2-be00-69c298bfe1d3'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:52 user nova-compute[74241]: INFO os_vif [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=91c8f08e-494c-469d-8dd8-5d5a387b8534,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c8f08e-49')
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No VIF found with MAC fa:16:3e:ba:0a:91, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-ac7dee4b-9779-4c2e-9d4b-0a831f65489f req-0de238c4-3df3-46d7-b322-61ec17ec6d6b service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Updated VIF entry in instance network info cache for port 91c8f08e-494c-469d-8dd8-5d5a387b8534. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-ac7dee4b-9779-4c2e-9d4b-0a831f65489f req-0de238c4-3df3-46d7-b322-61ec17ec6d6b service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Updating instance_info_cache with network_info: [{"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ac7dee4b-9779-4c2e-9d4b-0a831f65489f req-0de238c4-3df3-46d7-b322-61ec17ec6d6b service nova] Releasing lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-c19cdc6d-b038-493e-ae89-19ff4e565c76 req-c11403ac-48b3-43ec-bf83-ffd65e1227e0 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received event network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c19cdc6d-b038-493e-ae89-19ff4e565c76 req-c11403ac-48b3-43ec-bf83-ffd65e1227e0 service nova] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c19cdc6d-b038-493e-ae89-19ff4e565c76 req-c11403ac-48b3-43ec-bf83-ffd65e1227e0 service nova] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c19cdc6d-b038-493e-ae89-19ff4e565c76 req-c11403ac-48b3-43ec-bf83-ffd65e1227e0 service nova] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-c19cdc6d-b038-493e-ae89-19ff4e565c76 req-c11403ac-48b3-43ec-bf83-ffd65e1227e0 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] No waiting events found dispatching network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:53 user nova-compute[74241]: WARNING nova.compute.manager [req-c19cdc6d-b038-493e-ae89-19ff4e565c76 req-c11403ac-48b3-43ec-bf83-ffd65e1227e0 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received unexpected event network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 for instance with vm_state building and task_state spawning.
Oct 20 11:44:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jodyzBFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:44:55 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:44:55 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:44:55 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb6e022-f783-469b-a114-f5ce6925f655]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:44:55 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5880d030-9e71-436d-bba7-4fe1447bda87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207] added
Oct 20 11:44:55 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[103bcca3-495f-456f-8562-1f6ffdbb6fa1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[60910037-1367-448c-909f-9dae5e8c6949]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jodyzBFH {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.compute.manager [req-d986fb43-3f69-4d3a-afe8-3d6d04785174 req-944e7eb7-2058-47f8-a73f-48a5005fd139 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received event network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d986fb43-3f69-4d3a-afe8-3d6d04785174 req-944e7eb7-2058-47f8-a73f-48a5005fd139 service nova] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d986fb43-3f69-4d3a-afe8-3d6d04785174 req-944e7eb7-2058-47f8-a73f-48a5005fd139 service nova] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d986fb43-3f69-4d3a-afe8-3d6d04785174 req-944e7eb7-2058-47f8-a73f-48a5005fd139 service nova] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.compute.manager [req-d986fb43-3f69-4d3a-afe8-3d6d04785174 req-944e7eb7-2058-47f8-a73f-48a5005fd139 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] No waiting events found dispatching network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:44:55 user nova-compute[74241]: WARNING nova.compute.manager [req-d986fb43-3f69-4d3a-afe8-3d6d04785174 req-944e7eb7-2058-47f8-a73f-48a5005fd139 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received unexpected event network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 for instance with vm_state building and task_state spawning.
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jodyzBFH" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abbf760-f56c-4113-9056-784697700435]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jodyzBFH'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:55 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Instance spawned successfully.
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ca652e-3d39-440d-85f3-d249f722bbf6]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:44:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bfea53-b061-483d-af8c-3916a419cd88]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:56 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:44:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:56 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:44:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7548393-fb54-40f9-b65e-c905518d8227]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207, portal: 172.16.0.220,3260]
Oct 20 11:44:56 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207, portal: 172.16.0.220,3260] successful.
Oct 20 11:44:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:56 user nova-compute[74241]: INFO nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 20 11:44:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa7870-ced4-4811-bc14-8845b0f3b196]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef0dde1-b7bd-41ba-9a44-f260594c8c73]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:56 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:44:56 user nova-compute[74241]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 (non-flash)
Oct 20 11:44:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:44:56 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:44:56 user nova-compute[74241]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 (non-flash)
Oct 20 11:44:56 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5800af7e-b3cd-449f-8068-efd95f4cbacf]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jodyzBFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:44:56 user nova-compute[74241]: INFO nova.compute.manager [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Took 6.51 seconds to build instance.
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a60d874e-0667-44d6-8189-f8e0d9b896f6 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.658s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] <== connect_volume: return (1443ms) {'type': 'block', 'scsi_wwn': '26639393633313238', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639393633313238', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG nova.objects.instance [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lazy-loading 'flavor' on Instance uuid cf1199a8-5ce6-4778-a8e3-5eb176adde34 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:44:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:44:57 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:44:57 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:44:57 user nova-compute[74241]:   <serial>fa647bb4-70e4-4ea6-9189-cc43f9d62207</serial>
Oct 20 11:44:57 user nova-compute[74241]: </disk>
Oct 20 11:44:57 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] No VIF found with MAC fa:16:3e:ea:80:65, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fb60e8e9-e6d1-4208-951b-03c2264a4917 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.234s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:44:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:44:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:44:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:45:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7959MB free_disk=25.45065689086914GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:00 user nova-compute[74241]: INFO nova.compute.manager [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Detaching volume fa647bb4-70e4-4ea6-9189-cc43f9d62207
Oct 20 11:45:00 user nova-compute[74241]: INFO nova.virt.block_device [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Attempting to driver detach volume fa647bb4-70e4-4ea6-9189-cc43f9d62207 from mountpoint /dev/vdb
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Attempting to detach device vdb from instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:45:00 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:45:00 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:45:00 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:45:00 user nova-compute[74241]:   <serial>fa647bb4-70e4-4ea6-9189-cc43f9d62207</serial>
Oct 20 11:45:00 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:45:00 user nova-compute[74241]: </disk>
Oct 20 11:45:00 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Applying migration context for instance 5600826e-10a2-4079-bb18-a652aa279f45 as it has an incoming, in-progress migration 58075315-7dac-4059-ba4d-3007bdfa2624. Migration status is finished {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 11:45:00 user nova-compute[74241]: INFO nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating resource usage from migration 58075315-7dac-4059-ba4d-3007bdfa2624
Oct 20 11:45:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Successfully detached device vdb from instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 from the persistent domain config.
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:45:00 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:45:00 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:45:00 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:45:00 user nova-compute[74241]:   <serial>fa647bb4-70e4-4ea6-9189-cc43f9d62207</serial>
Oct 20 11:45:00 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:45:00 user nova-compute[74241]: </disk>
Oct 20 11:45:00 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Migration 58075315-7dac-4059-ba4d-3007bdfa2624 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5600826e-10a2-4079-bb18-a652aa279f45 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:45:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:45:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:45:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:45:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:45:01 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Updating instance_info_cache with network_info: [{"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-df39a80e-8be5-4453-a0f3-866d00c27f65" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:20 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 is timed out.
Oct 20 11:45:20 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Successfully detached device vdb from instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 from the live domain config.
Oct 20 11:45:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jodyzBFH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:45:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc158a8-5e4a-42da-812c-117d658d97b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:45:20 user nova-compute[74241]: No targets found.
Oct 20 11:45:20 user nova-compute[74241]: iSNS:
Oct 20 11:45:20 user nova-compute[74241]: No targets found.
Oct 20 11:45:20 user nova-compute[74241]: STATIC:
Oct 20 11:45:20 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207
Oct 20 11:45:20 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:45:20 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:45:20 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c
Oct 20 11:45:20 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:45:20 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:45:20 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293
Oct 20 11:45:20 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:45:20 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:45:20 user nova-compute[74241]: FIRMWARE:
Oct 20 11:45:20 user nova-compute[74241]: No targets found.
Oct 20 11:45:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:45:20 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:45:20 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7ca45a-a8d9-4dba-9328-73a99332dfd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[47616f94-2e79-45f6-9825-9db2ea631d75]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:45:20 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:45:20 user nova-compute[74241]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 (non-flash)
Oct 20 11:45:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:45:20 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:45:20 user nova-compute[74241]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 (non-flash)
Oct 20 11:45:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5228376f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207'): ({'sdd'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Removing single pathed devices sdd {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6c72da-4f36-41c6-ad6a-951052a5a951]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d6f91a-e349-409f-8a93-bd299391ad8e]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Flushing IO for device /dev/sdd {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d85a82b-bfdf-4066-81f1-5ea0de1add37]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf4549b-ad09-43f1-a1b8-e2250e36d40e]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:45:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf42f842-9e20-4da0-8ad9-2cd4d92e7ca5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d88dd8d-c3f6-4174-bded-07aa4d807976]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207, portal: 172.16.0.220,3260]
Oct 20 11:45:21 user nova-compute[74241]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207, portal: 172.16.0.220,3260] successful.
Oct 20 11:45:21 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa647bb4-70e4-4ea6-9189-cc43f9d62207 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68dedd4-4b4a-4c6f-9cc0-42a76b275d92]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] <== disconnect_volume: return (314ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:45:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:45:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:36 user nova-compute[74241]: DEBUG nova.network.neutron [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Port 057c0964-5838-4c58-84aa-e479c46f8835 binding to destination host user is already ACTIVE {{(pid=74241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 11:45:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:45:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquired lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:45:36 user nova-compute[74241]: DEBUG nova.network.neutron [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG nova.network.neutron [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Releasing lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Creating tmpfile /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/tmp0ft8ucq6 to verify with other compute node that the instance is on the same shared storage. {{(pid=74241) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG nova.compute.manager [req-4b0a9d8a-3b76-4188-9c9c-f1a1c4572764 req-0326096c-aae0-48ee-bda4-12098a79f079 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4b0a9d8a-3b76-4188-9c9c-f1a1c4572764 req-0326096c-aae0-48ee-bda4-12098a79f079 service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4b0a9d8a-3b76-4188-9c9c-f1a1c4572764 req-0326096c-aae0-48ee-bda4-12098a79f079 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4b0a9d8a-3b76-4188-9c9c-f1a1c4572764 req-0326096c-aae0-48ee-bda4-12098a79f079 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:45:37 user nova-compute[74241]: DEBUG nova.compute.manager [req-4b0a9d8a-3b76-4188-9c9c-f1a1c4572764 req-0326096c-aae0-48ee-bda4-12098a79f079 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:45:37 user nova-compute[74241]: WARNING nova.compute.manager [req-4b0a9d8a-3b76-4188-9c9c-f1a1c4572764 req-0326096c-aae0-48ee-bda4-12098a79f079 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state resized and task_state resize_reverting.
Oct 20 11:45:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance destroyed successfully.
Oct 20 11:45:37 user nova-compute[74241]: DEBUG nova.objects.instance [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lazy-loading 'resources' on Instance uuid 5600826e-10a2-4079-bb18-a652aa279f45 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:44:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_vif [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap057c0964-58, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b36047e2-dc01-427d-a554-1c1a26bcf11e) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:38 user nova-compute[74241]: INFO os_vif [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58')
Oct 20 11:45:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:45:38 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73566c-0ee7-4115-85e8-d5544615de15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:45:38 user nova-compute[74241]: No targets found.
Oct 20 11:45:38 user nova-compute[74241]: iSNS:
Oct 20 11:45:38 user nova-compute[74241]: No targets found.
Oct 20 11:45:38 user nova-compute[74241]: STATIC:
Oct 20 11:45:38 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c
Oct 20 11:45:38 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:45:38 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:45:38 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293
Oct 20 11:45:38 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:45:38 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:45:38 user nova-compute[74241]: FIRMWARE:
Oct 20 11:45:38 user nova-compute[74241]: No targets found.
Oct 20 11:45:38 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:45:38 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:45:38 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae6d3ea-220c-4598-a130-8d01e413bd2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f462a1-381b-40cc-9086-c90bf3a09811]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:45:38 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:45:38 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:45:38 user nova-compute[74241]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:45:38 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5228374040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d634df-1866-4c86-bb25-db09ffb1cdc8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a153329f-cb9f-43fb-9ccf-a07cc67abb8e]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e71ffa-58cf-4f40-ba28-545c3fd63fbe]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73a3a4b-5d44-499c-9ce6-f525b9308de4]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f7f58a-49cd-4108-8f54-e80e32f6f030]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbdbabf-5694-47ba-8c91-82f45a735a44]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]
Oct 20 11:45:38 user nova-compute[74241]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.
Oct 20 11:45:38 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8764eef3-d803-4237-b7c0-c61a9c64372c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== disconnect_volume: return (301ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:45:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG nova.objects.instance [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lazy-loading 'migration_context' on Instance uuid 5600826e-10a2-4079-bb18-a652aa279f45 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG nova.objects.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Object Instance<5600826e-10a2-4079-bb18-a652aa279f45> lazy-loaded attributes: resources,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-c473de4e-7320-42ba-80dd-9146c7b2c3f9 req-ae0e7ae3-87af-49d1-9937-0036e0c671f5 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c473de4e-7320-42ba-80dd-9146c7b2c3f9 req-ae0e7ae3-87af-49d1-9937-0036e0c671f5 service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c473de4e-7320-42ba-80dd-9146c7b2c3f9 req-ae0e7ae3-87af-49d1-9937-0036e0c671f5 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c473de4e-7320-42ba-80dd-9146c7b2c3f9 req-ae0e7ae3-87af-49d1-9937-0036e0c671f5 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-c473de4e-7320-42ba-80dd-9146c7b2c3f9 req-ae0e7ae3-87af-49d1-9937-0036e0c671f5 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:45:39 user nova-compute[74241]: WARNING nova.compute.manager [req-c473de4e-7320-42ba-80dd-9146c7b2c3f9 req-ae0e7ae3-87af-49d1-9937-0036e0c671f5 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state resized and task_state resize_reverting.
Oct 20 11:45:39 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:45:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.414s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:45:39 user nova-compute[74241]: INFO nova.compute.manager [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Swapping old allocation on dict_keys(['34e63c41-61c0-494b-ac17-d5bfda3fa5f2']) held by migration 58075315-7dac-4059-ba4d-3007bdfa2624 for instance
Oct 20 11:45:39 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Overwriting current allocation {'allocations': {'34e63c41-61c0-494b-ac17-d5bfda3fa5f2': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 28}}, 'project_id': '8956d1d704f54819b417cd6e5c7abd27', 'user_id': '0195b190e68a42be9877144bfe0cb277', 'consumer_generation': 1} on consumer 5600826e-10a2-4079-bb18-a652aa279f45 {{(pid=74241) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquired lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG nova.network.neutron [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG nova.network.neutron [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Releasing lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG os_brick.utils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[21faff52-6b7e-4b2c-b0b1-4980eb6c62b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[025fbaef-9a54-45dc-8d29-afda6e4c1964]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f046da8-1398-4118-82f7-7c2d889790d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8755284-3d85-4cb4-a432-e82ea77e3780]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:45:40 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:45:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec5965b-6abf-4cd9-b44e-47d12a412bf0]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:45:40 user nova-compute[74241]: DEBUG os_brick.utils [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:45:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:48 user nova-compute[74241]: DEBUG nova.objects.instance [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lazy-loading 'flavor' on Instance uuid cf1199a8-5ce6-4778-a8e3-5eb176adde34 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:45:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f683453-844d-4385-86fc-373e6ab01830 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 47.985s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:45:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:45:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:49 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:45:49 user nova-compute[74241]: INFO nova.compute.claims [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Claim successful on node user
Oct 20 11:45:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG nova.network.neutron [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:45:50 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:45:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG nova.policy [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d7605635edc4cf9bddad897b8c18b77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4449c61c4f64b2f96f4ac79b72c8f95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:45:50 user nova-compute[74241]: INFO nova.virt.block_device [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Booting with volume c73cbcf1-5531-4645-9169-696fb9e4106a at /dev/vda
Oct 20 11:45:50 user nova-compute[74241]: DEBUG os_brick.utils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f95866a-160f-444b-9ec1-5b1c2d1b1733]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbfc8ff-27a1-4e02-b044-42a60db3bda5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119a7f1-a2eb-4d22-8a72-4ce8c3246559]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9186b8d-a967-4e21-86fa-00179fef856f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:45:50 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:45:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[630838a9-66d3-45de-b898-26c4b3a27d23]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG os_brick.utils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:45:50 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating existing volume attachment record: 0618e06b-eb7e-49b2-ad0d-643a6ff6df17 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:45:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Successfully created port: cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:45:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Successfully updated port: cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:45:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:45:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquired lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:45:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:45:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-95fdc6ef-7f44-4992-b6bf-f5767237a078 req-82ce8ccc-051d-4b1b-94f4-4420bbd68f20 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-changed-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:45:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-95fdc6ef-7f44-4992-b6bf-f5767237a078 req-82ce8ccc-051d-4b1b-94f4-4420bbd68f20 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Refreshing instance network info cache due to event network-changed-cc29a2ea-992b-40bd-a9fe-dc880128123a. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:45:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95fdc6ef-7f44-4992-b6bf-f5767237a078 req-82ce8ccc-051d-4b1b-94f4-4420bbd68f20 service nova] Acquiring lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG nova.network.neutron [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG nova.network.neutron [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating instance_info_cache with network_info: [{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Releasing lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance network_info: |[{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95fdc6ef-7f44-4992-b6bf-f5767237a078 req-82ce8ccc-051d-4b1b-94f4-4420bbd68f20 service nova] Acquired lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-95fdc6ef-7f44-4992-b6bf-f5767237a078 req-82ce8ccc-051d-4b1b-94f4-4420bbd68f20 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Refreshing network info cache for port cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-95fdc6ef-7f44-4992-b6bf-f5767237a078 req-82ce8ccc-051d-4b1b-94f4-4420bbd68f20 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updated VIF entry in instance network info cache for port cc29a2ea-992b-40bd-a9fe-dc880128123a. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-95fdc6ef-7f44-4992-b6bf-f5767237a078 req-82ce8ccc-051d-4b1b-94f4-4420bbd68f20 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating instance_info_cache with network_info: [{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:45:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95fdc6ef-7f44-4992-b6bf-f5767237a078 req-82ce8ccc-051d-4b1b-94f4-4420bbd68f20 service nova] Releasing lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:45:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:45:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:45:53 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:45:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:45:57 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8109MB free_disk=25.41903305053711GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5600826e-10a2-4079-bb18-a652aa279f45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:45:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Starting finish_revert_migration {{(pid=74241) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Start _get_guest_xml network_info=[{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '192cbe7d-3589-4075-b47e-da938a5851ab', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5600826e-10a2-4079-bb18-a652aa279f45', 'attached_at': '2023-10-20T11:45:58.000000', 'detached_at': '', 'volume_id': 'afbcfb2c-1df6-496b-919f-a063331dc64c', 'serial': 'afbcfb2c-1df6-496b-919f-a063331dc64c'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:45:58 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:45:58 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.objects.instance [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5600826e-10a2-4079-bb18-a652aa279f45 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:45:58 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:45:58 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:45:58 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5828d656-39dc-4f36-a98e-951c0db23278]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:45:58 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1128fbe-9d5a-4e26-862c-9913abda5bc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c] added
Oct 20 11:45:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2378fcd0-af66-4553-a28e-a5f840d5b03e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[690558af-71a7-490e-bca4-b15ce6e40ad5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGnkeIfA {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGnkeIfA" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d407278-4743-4ecc-8c69-fd8bcd0b4371]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EGnkeIfA'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a05c8b-3960-439b-a804-c204afb3bb0e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd2f15e-df13-42cd-8c26-90edbb0bfe71]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:45:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:45:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e904dea3-e4d7-4f6e-8f1e-6178ed539cf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]
Oct 20 11:45:58 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.
Oct 20 11:45:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e692c21a-99ef-4ab6-b6b5-a402658303a1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2380fe8-6059-47a4-a3ac-49f42266f39b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:45:58 user nova-compute[74241]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:45:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:45:58 user nova-compute[74241]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:45:58 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[be392df8-56fe-4c2f-9805-81df3a7a0ac8]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:45:58 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23030303036326130', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030303036326130', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:44:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:45:59 user nova-compute[74241]:   <uuid>5600826e-10a2-4079-bb18-a652aa279f45</uuid>
Oct 20 11:45:59 user nova-compute[74241]:   <name>instance-00000011</name>
Oct 20 11:45:59 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:45:59 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:45:59 user nova-compute[74241]:   <metadata>
Oct 20 11:45:59 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:45:59 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:45:59 user nova-compute[74241]:       <nova:name>tempest-ServerActionsTestOtherB-server-1518638015</nova:name>
Oct 20 11:45:59 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:45:58</nova:creationTime>
Oct 20 11:45:59 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:45:59 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:45:59 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:45:59 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:45:59 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:45:59 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:45:59 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:45:59 user nova-compute[74241]:       <nova:owner>
Oct 20 11:45:59 user nova-compute[74241]:         <nova:user uuid="0195b190e68a42be9877144bfe0cb277">tempest-ServerActionsTestOtherB-805994491-project-member</nova:user>
Oct 20 11:45:59 user nova-compute[74241]:         <nova:project uuid="8956d1d704f54819b417cd6e5c7abd27">tempest-ServerActionsTestOtherB-805994491</nova:project>
Oct 20 11:45:59 user nova-compute[74241]:       </nova:owner>
Oct 20 11:45:59 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:45:59 user nova-compute[74241]:       <nova:ports>
Oct 20 11:45:59 user nova-compute[74241]:         <nova:port uuid="057c0964-5838-4c58-84aa-e479c46f8835">
Oct 20 11:45:59 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 11:45:59 user nova-compute[74241]:         </nova:port>
Oct 20 11:45:59 user nova-compute[74241]:       </nova:ports>
Oct 20 11:45:59 user nova-compute[74241]:     </nova:instance>
Oct 20 11:45:59 user nova-compute[74241]:   </metadata>
Oct 20 11:45:59 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:45:59 user nova-compute[74241]:     <system>
Oct 20 11:45:59 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:45:59 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:45:59 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:45:59 user nova-compute[74241]:       <entry name="serial">5600826e-10a2-4079-bb18-a652aa279f45</entry>
Oct 20 11:45:59 user nova-compute[74241]:       <entry name="uuid">5600826e-10a2-4079-bb18-a652aa279f45</entry>
Oct 20 11:45:59 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:45:59 user nova-compute[74241]:     </system>
Oct 20 11:45:59 user nova-compute[74241]:   </sysinfo>
Oct 20 11:45:59 user nova-compute[74241]:   <os>
Oct 20 11:45:59 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:45:59 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:45:59 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:45:59 user nova-compute[74241]:   </os>
Oct 20 11:45:59 user nova-compute[74241]:   <features>
Oct 20 11:45:59 user nova-compute[74241]:     <acpi/>
Oct 20 11:45:59 user nova-compute[74241]:     <apic/>
Oct 20 11:45:59 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:45:59 user nova-compute[74241]:   </features>
Oct 20 11:45:59 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:45:59 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:45:59 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:45:59 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:45:59 user nova-compute[74241]:   </clock>
Oct 20 11:45:59 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:45:59 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:45:59 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:45:59 user nova-compute[74241]:   </cpu>
Oct 20 11:45:59 user nova-compute[74241]:   <devices>
Oct 20 11:45:59 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:45:59 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:45:59 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk"/>
Oct 20 11:45:59 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:45:59 user nova-compute[74241]:     </disk>
Oct 20 11:45:59 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:45:59 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:45:59 user nova-compute[74241]:       <source dev="/dev/sdb"/>
Oct 20 11:45:59 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:45:59 user nova-compute[74241]:       <serial>afbcfb2c-1df6-496b-919f-a063331dc64c</serial>
Oct 20 11:45:59 user nova-compute[74241]:     </disk>
Oct 20 11:45:59 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:45:59 user nova-compute[74241]:       <mac address="fa:16:3e:64:d9:51"/>
Oct 20 11:45:59 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:45:59 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:45:59 user nova-compute[74241]:       <target dev="tap057c0964-58"/>
Oct 20 11:45:59 user nova-compute[74241]:     </interface>
Oct 20 11:45:59 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:45:59 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/console.log" append="off"/>
Oct 20 11:45:59 user nova-compute[74241]:     </serial>
Oct 20 11:45:59 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:45:59 user nova-compute[74241]:     <video>
Oct 20 11:45:59 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:45:59 user nova-compute[74241]:     </video>
Oct 20 11:45:59 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:45:59 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:45:59 user nova-compute[74241]:     </rng>
Oct 20 11:45:59 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:45:59 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:45:59 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:45:59 user nova-compute[74241]:     </memballoon>
Oct 20 11:45:59 user nova-compute[74241]:   </devices>
Oct 20 11:45:59 user nova-compute[74241]: </domain>
Oct 20 11:45:59 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:44:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:45:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG os_vif [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2731e578-58fd-5bfc-b530-43668eb2a4c3', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap057c0964-58, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap057c0964-58, col_values=(('qos', UUID('3e93114f-fd40-45e9-81b9-4c5388866479')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap057c0964-58, col_values=(('external_ids', {'iface-id': '057c0964-5838-4c58-84aa-e479c46f8835', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:d9:51', 'vm-uuid': '5600826e-10a2-4079-bb18-a652aa279f45'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:45:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:00 user nova-compute[74241]: INFO os_vif [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58')
Oct 20 11:46:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [{"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:46:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-5600826e-10a2-4079-bb18-a652aa279f45" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:46:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:46:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-c20d3905-100b-4e5e-a985-076cd02cde23 req-27605efd-af8a-4ff5-a930-2b846736fc88 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c20d3905-100b-4e5e-a985-076cd02cde23 req-27605efd-af8a-4ff5-a930-2b846736fc88 service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c20d3905-100b-4e5e-a985-076cd02cde23 req-27605efd-af8a-4ff5-a930-2b846736fc88 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c20d3905-100b-4e5e-a985-076cd02cde23 req-27605efd-af8a-4ff5-a930-2b846736fc88 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-c20d3905-100b-4e5e-a985-076cd02cde23 req-27605efd-af8a-4ff5-a930-2b846736fc88 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:46:01 user nova-compute[74241]: WARNING nova.compute.manager [req-c20d3905-100b-4e5e-a985-076cd02cde23 req-27605efd-af8a-4ff5-a930-2b846736fc88 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state resized and task_state resize_reverting.
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:03 user nova-compute[74241]: DEBUG nova.compute.manager [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:46:03 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance running successfully.
Oct 20 11:46:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] finish_revert_migration finished successfully. {{(pid=74241) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 20 11:46:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-ece43c1e-2339-4b49-aae3-a083bd1aa2f0 req-a91611e1-3b58-4b7f-8b3a-397ef1be488a service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ece43c1e-2339-4b49-aae3-a083bd1aa2f0 req-a91611e1-3b58-4b7f-8b3a-397ef1be488a service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ece43c1e-2339-4b49-aae3-a083bd1aa2f0 req-a91611e1-3b58-4b7f-8b3a-397ef1be488a service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ece43c1e-2339-4b49-aae3-a083bd1aa2f0 req-a91611e1-3b58-4b7f-8b3a-397ef1be488a service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-ece43c1e-2339-4b49-aae3-a083bd1aa2f0 req-a91611e1-3b58-4b7f-8b3a-397ef1be488a service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:46:03 user nova-compute[74241]: WARNING nova.compute.manager [req-ece43c1e-2339-4b49-aae3-a083bd1aa2f0 req-a91611e1-3b58-4b7f-8b3a-397ef1be488a service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state resized and task_state resize_reverting.
Oct 20 11:46:03 user nova-compute[74241]: INFO nova.compute.manager [None req-643d5a6d-0462-48b1-99b4-d0e13a8e6a5b tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance to original state: 'active'
Oct 20 11:46:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:46:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Creating image(s)
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Ensure instance console log exists: /opt/stack/data/nova/instances/ec07982b-d7ea-4950-aca1-c6120927cfb0/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Start _get_guest_xml network_info=[{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '0618e06b-eb7e-49b2-ad0d-643a6ff6df17', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQwNjaDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec07982b-d7ea-4950-aca1-c6120927cfb0', 'attached_at': '', 'detached_at': '', 'volume_id': 'c73cbcf1-5531-4645-9169-696fb9e4106a', 'serial': 'c73cbcf1-5531-4645-9169-696fb9e4106a'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:46:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:46:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQwNjaDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:46:08 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:46:08 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:46:08 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf7e67d-42b7-433d-8c46-3687fc5e1e28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:46:08 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d486b57c-38a2-4925-be07-c3097dbde860]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a] added
Oct 20 11:46:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a6f9d3-4ebe-4c41-a2d1-af5bd92bd8c9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad45d3f0-f751-4a08-aa97-3f2db4e2bff0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQwNjaDF {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQwNjaDF" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1cf5be-9740-4fe3-a807-10cff5b15ed7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bQwNjaDF'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1bed38-f039-4a20-9fd3-4c88e763ba4d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[da156d59-4a06-467f-8836-89386fc694af]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:46:08 user nova-compute[74241]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:46:08 user nova-compute[74241]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65e271c-1ab0-47b3-8893-4183f4ca1ff6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260]
Oct 20 11:46:08 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260] successful.
Oct 20 11:46:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[42756f45-adb6-4b9b-9682-99823cdb7b45]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed23c8bf-fba5-4614-ab2d-b4b70df65a79]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:46:08 user nova-compute[74241]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:08 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:46:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:46:08 user nova-compute[74241]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:08 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:46:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a555de-3131-4d15-8a94-29f5fa3e8ee4]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:46:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQwNjaDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23662376235636234', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662376235636234', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1668348691',display_name='tempest-ServerActionsTestOtherA-server-1668348691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1668348691',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-yx7a60yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=ec07982b-d7ea-4950-aca1-c6120927cfb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.objects.instance [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'pci_devices' on Instance uuid ec07982b-d7ea-4950-aca1-c6120927cfb0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:46:09 user nova-compute[74241]:   <uuid>ec07982b-d7ea-4950-aca1-c6120927cfb0</uuid>
Oct 20 11:46:09 user nova-compute[74241]:   <name>instance-00000019</name>
Oct 20 11:46:09 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:46:09 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:46:09 user nova-compute[74241]:   <metadata>
Oct 20 11:46:09 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:46:09 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:46:09 user nova-compute[74241]:       <nova:name>tempest-ServerActionsTestOtherA-server-1668348691</nova:name>
Oct 20 11:46:09 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:46:08</nova:creationTime>
Oct 20 11:46:09 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:46:09 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:46:09 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:46:09 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:46:09 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:46:09 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:46:09 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:46:09 user nova-compute[74241]:       <nova:owner>
Oct 20 11:46:09 user nova-compute[74241]:         <nova:user uuid="3d7605635edc4cf9bddad897b8c18b77">tempest-ServerActionsTestOtherA-1364765065-project-member</nova:user>
Oct 20 11:46:09 user nova-compute[74241]:         <nova:project uuid="f4449c61c4f64b2f96f4ac79b72c8f95">tempest-ServerActionsTestOtherA-1364765065</nova:project>
Oct 20 11:46:09 user nova-compute[74241]:       </nova:owner>
Oct 20 11:46:09 user nova-compute[74241]:       <nova:ports>
Oct 20 11:46:09 user nova-compute[74241]:         <nova:port uuid="cc29a2ea-992b-40bd-a9fe-dc880128123a">
Oct 20 11:46:09 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 11:46:09 user nova-compute[74241]:         </nova:port>
Oct 20 11:46:09 user nova-compute[74241]:       </nova:ports>
Oct 20 11:46:09 user nova-compute[74241]:     </nova:instance>
Oct 20 11:46:09 user nova-compute[74241]:   </metadata>
Oct 20 11:46:09 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:46:09 user nova-compute[74241]:     <system>
Oct 20 11:46:09 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:46:09 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:46:09 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:46:09 user nova-compute[74241]:       <entry name="serial">ec07982b-d7ea-4950-aca1-c6120927cfb0</entry>
Oct 20 11:46:09 user nova-compute[74241]:       <entry name="uuid">ec07982b-d7ea-4950-aca1-c6120927cfb0</entry>
Oct 20 11:46:09 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:46:09 user nova-compute[74241]:     </system>
Oct 20 11:46:09 user nova-compute[74241]:   </sysinfo>
Oct 20 11:46:09 user nova-compute[74241]:   <os>
Oct 20 11:46:09 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:46:09 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:46:09 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:46:09 user nova-compute[74241]:   </os>
Oct 20 11:46:09 user nova-compute[74241]:   <features>
Oct 20 11:46:09 user nova-compute[74241]:     <acpi/>
Oct 20 11:46:09 user nova-compute[74241]:     <apic/>
Oct 20 11:46:09 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:46:09 user nova-compute[74241]:   </features>
Oct 20 11:46:09 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:46:09 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:46:09 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:46:09 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:46:09 user nova-compute[74241]:   </clock>
Oct 20 11:46:09 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:46:09 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:46:09 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:46:09 user nova-compute[74241]:   </cpu>
Oct 20 11:46:09 user nova-compute[74241]:   <devices>
Oct 20 11:46:09 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:46:09 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:46:09 user nova-compute[74241]:       <source dev="/dev/sdd"/>
Oct 20 11:46:09 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:46:09 user nova-compute[74241]:       <serial>c73cbcf1-5531-4645-9169-696fb9e4106a</serial>
Oct 20 11:46:09 user nova-compute[74241]:     </disk>
Oct 20 11:46:09 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:46:09 user nova-compute[74241]:       <mac address="fa:16:3e:ea:5c:9e"/>
Oct 20 11:46:09 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:46:09 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:46:09 user nova-compute[74241]:       <target dev="tapcc29a2ea-99"/>
Oct 20 11:46:09 user nova-compute[74241]:     </interface>
Oct 20 11:46:09 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:46:09 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/ec07982b-d7ea-4950-aca1-c6120927cfb0/console.log" append="off"/>
Oct 20 11:46:09 user nova-compute[74241]:     </serial>
Oct 20 11:46:09 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:46:09 user nova-compute[74241]:     <video>
Oct 20 11:46:09 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:46:09 user nova-compute[74241]:     </video>
Oct 20 11:46:09 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:46:09 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:46:09 user nova-compute[74241]:     </rng>
Oct 20 11:46:09 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:46:09 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:46:09 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:46:09 user nova-compute[74241]:     </memballoon>
Oct 20 11:46:09 user nova-compute[74241]:   </devices>
Oct 20 11:46:09 user nova-compute[74241]: </domain>
Oct 20 11:46:09 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1668348691',display_name='tempest-ServerActionsTestOtherA-server-1668348691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1668348691',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-yx7a60yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=ec07982b-d7ea-4950-aca1-c6120927cfb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG os_vif [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e4734e4-beb9-5ca2-b826-c1c458a6cb0a', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc29a2ea-99, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc29a2ea-99, col_values=(('qos', UUID('70575cb8-bdd3-426b-a12d-e11d2714aeb6')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc29a2ea-99, col_values=(('external_ids', {'iface-id': 'cc29a2ea-992b-40bd-a9fe-dc880128123a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:5c:9e', 'vm-uuid': 'ec07982b-d7ea-4950-aca1-c6120927cfb0'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:09 user nova-compute[74241]: INFO os_vif [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99')
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:46:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No VIF found with MAC fa:16:3e:ea:5c:9e, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:46:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-fadb085b-436d-4bae-adbc-b9534a66b4d4 req-900ba66b-0efb-40d0-a398-a559bd43cc56 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fadb085b-436d-4bae-adbc-b9534a66b4d4 req-900ba66b-0efb-40d0-a398-a559bd43cc56 service nova] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fadb085b-436d-4bae-adbc-b9534a66b4d4 req-900ba66b-0efb-40d0-a398-a559bd43cc56 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fadb085b-436d-4bae-adbc-b9534a66b4d4 req-900ba66b-0efb-40d0-a398-a559bd43cc56 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-fadb085b-436d-4bae-adbc-b9534a66b4d4 req-900ba66b-0efb-40d0-a398-a559bd43cc56 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] No waiting events found dispatching network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:46:11 user nova-compute[74241]: WARNING nova.compute.manager [req-fadb085b-436d-4bae-adbc-b9534a66b4d4 req-900ba66b-0efb-40d0-a398-a559bd43cc56 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received unexpected event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a for instance with vm_state building and task_state spawning.
Oct 20 11:46:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:46:13 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance spawned successfully.
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-0ddc6cdb-3108-4beb-a800-aefc78681794 req-e701e8fc-e340-4e6f-859e-d18ae01bf97f service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0ddc6cdb-3108-4beb-a800-aefc78681794 req-e701e8fc-e340-4e6f-859e-d18ae01bf97f service nova] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0ddc6cdb-3108-4beb-a800-aefc78681794 req-e701e8fc-e340-4e6f-859e-d18ae01bf97f service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0ddc6cdb-3108-4beb-a800-aefc78681794 req-e701e8fc-e340-4e6f-859e-d18ae01bf97f service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-0ddc6cdb-3108-4beb-a800-aefc78681794 req-e701e8fc-e340-4e6f-859e-d18ae01bf97f service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] No waiting events found dispatching network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:46:13 user nova-compute[74241]: WARNING nova.compute.manager [req-0ddc6cdb-3108-4beb-a800-aefc78681794 req-e701e8fc-e340-4e6f-859e-d18ae01bf97f service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received unexpected event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a for instance with vm_state building and task_state spawning.
Oct 20 11:46:13 user nova-compute[74241]: INFO nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 20 11:46:13 user nova-compute[74241]: DEBUG nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:46:13 user nova-compute[74241]: INFO nova.compute.manager [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Took 23.34 seconds to build instance.
Oct 20 11:46:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-246e9de8-bad5-4eb9-92de-0063fa1e8b09 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.451s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG nova.objects.instance [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquired lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG nova.objects.instance [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'info_cache' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG nova.objects.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating instance_info_cache with network_info: [{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:46:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Releasing lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:46:20 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance destroyed successfully.
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'resources' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.objects.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_vif [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd970e2bd-a0, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1a770e6-e7b7-40af-bc02-1b613b78fc08) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: INFO os_vif [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0')
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuAMeSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:46:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f01721-7163-40f4-abfc-06dbd32cb32e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:46:20 user nova-compute[74241]: No targets found.
Oct 20 11:46:20 user nova-compute[74241]: iSNS:
Oct 20 11:46:20 user nova-compute[74241]: No targets found.
Oct 20 11:46:20 user nova-compute[74241]: STATIC:
Oct 20 11:46:20 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a
Oct 20 11:46:20 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:46:20 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:46:20 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c
Oct 20 11:46:20 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:46:20 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:46:20 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293
Oct 20 11:46:20 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:46:20 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:46:20 user nova-compute[74241]: FIRMWARE:
Oct 20 11:46:20 user nova-compute[74241]: No targets found.
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:46:20 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:46:20 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[10017282-872a-4300-b635-b0c997fe3b12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[64146911-1b6d-468f-a2e7-f710aa4a0f61]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5228479090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb1a151-5f71-48bd-91b6-ca4b8f13631e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de0aac9-c3bc-4ae7-a51a-3ff63fe48ca0]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e43c156-4d3f-4545-b3c4-b8a896307ffa]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c005ab7b-12a3-49d2-972a-dd5000169f63]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfec97a-224e-48fe-8d01-240bca5e61ee]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:20 user nova-compute[74241]: INFO nova.compute.manager [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Terminating instance
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[89af7c1a-6a6d-43dd-b7a8-ba62a7695186]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260]
Oct 20 11:46:20 user nova-compute[74241]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260] successful.
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ae9bb9-67b0-4fa1-b92b-f76147210a9c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== disconnect_volume: return (328ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Start _get_guest_xml network_info=[{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '6c42e016-8053-476b-b702-84709f2bc4fa', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuAMeSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '333dae7f-9914-4604-a36b-8e5d4d2a4bce', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6a2a855-9804-4cce-ab2a-79a4cbe45293', 'serial': 'a6a2a855-9804-4cce-ab2a-79a4cbe45293'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'numa_topology' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.objects.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:46:20 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:46:20 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'vcpu_model' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.objects.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuAMeSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:46:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:46:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:46:20 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:46:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa6f58f-e26f-4365-811e-1b6f6affa1e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:46:20 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e84f989-2ba5-439e-8159-3db283fc6dbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293] added
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.061s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b33fda-44b1-4b5c-a466-89e80f78ab81]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-9e3de228-0040-41bf-8385-02d5efdc89b4 req-e7e78d1c-d408-47b5-a077-b11c86b04b86 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received event network-vif-unplugged-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9e3de228-0040-41bf-8385-02d5efdc89b4 req-e7e78d1c-d408-47b5-a077-b11c86b04b86 service nova] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9e3de228-0040-41bf-8385-02d5efdc89b4 req-e7e78d1c-d408-47b5-a077-b11c86b04b86 service nova] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9e3de228-0040-41bf-8385-02d5efdc89b4 req-e7e78d1c-d408-47b5-a077-b11c86b04b86 service nova] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-9e3de228-0040-41bf-8385-02d5efdc89b4 req-e7e78d1c-d408-47b5-a077-b11c86b04b86 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] No waiting events found dispatching network-vif-unplugged-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-9e3de228-0040-41bf-8385-02d5efdc89b4 req-e7e78d1c-d408-47b5-a077-b11c86b04b86 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received event network-vif-unplugged-bfe47f4d-715c-460b-ae2a-b038484d38ff for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6e2270-28d2-4b34-9497-d71df3a77c4e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuAMeSbi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LuAMeSbi" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09e2054-4fdb-4843-aa91-a8bdbb44d77c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LuAMeSbi'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5ddfc0-b70f-4974-a3e7-4b85ebb501a7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6236ebd4-ef37-469b-8299-f90467195331]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069f965-d9aa-472d-a7b7-fd5e5a8ff2df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260]
Oct 20 11:46:20 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260] successful.
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef11cd72-e767-4fd8-9c83-930284d0addd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d75b57-4a4a-4fdf-bcf9-235eb06e5080]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:46:20 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:46:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a5dee6-cb4b-4898-9d7c-b7578711c529]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:46:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuAMeSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:46:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Instance destroyed successfully.
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.objects.instance [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lazy-loading 'resources' on Instance uuid cf1199a8-5ce6-4778-a8e3-5eb176adde34 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-780403703',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-780403703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7804037',id=23,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIR75vWxT4QoRAhS+wEAWVTVdwhMycV1hOsjRMEzODiEeskR0u4mSFOWIbIUonGVJV+PMa87JwMRvUDTiunuJQxazL3KNBhB7msRzKlX+aUXJZajiNowESJI+0O7q7zcA==',key_name='tempest-keypair-137162409',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79fd876f66c04337973cbc49d1f8cdfa',ramdisk_id='',reservation_id='r-81yk3ol2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-801770068',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:42:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ab350bf7c74e47b9a941ba537410cdcd',uuid=cf1199a8-5ce6-4778-a8e3-5eb176adde34,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Converting VIF {"id": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "address": "fa:16:3e:ea:80:65", "network": {"id": "7961c994-a114-441d-b9fc-0063bd856433", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1563649521-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79fd876f66c04337973cbc49d1f8cdfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe47f4d-71", "ovs_interfaceid": "bfe47f4d-715c-460b-ae2a-b038484d38ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:80:65,bridge_name='br-int',has_traffic_filtering=True,id=bfe47f4d-715c-460b-ae2a-b038484d38ff,network=Network(7961c994-a114-441d-b9fc-0063bd856433),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe47f4d-71') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG os_vif [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:80:65,bridge_name='br-int',has_traffic_filtering=True,id=bfe47f4d-715c-460b-ae2a-b038484d38ff,network=Network(7961c994-a114-441d-b9fc-0063bd856433),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe47f4d-71') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfe47f4d-71, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5b0f22e-0464-45c0-9181-58cca10ae78c) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:21 user nova-compute[74241]: INFO os_vif [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:80:65,bridge_name='br-int',has_traffic_filtering=True,id=bfe47f4d-715c-460b-ae2a-b038484d38ff,network=Network(7961c994-a114-441d-b9fc-0063bd856433),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfe47f4d-71')
Oct 20 11:46:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Deleting instance files /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34_del
Oct 20 11:46:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Deletion of /opt/stack/data/nova/instances/cf1199a8-5ce6-4778-a8e3-5eb176adde34_del complete
Oct 20 11:46:21 user nova-compute[74241]: INFO nova.compute.manager [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 20 11:46:21 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23338323166636666', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338323166636666', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.objects.instance [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'pci_devices' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.objects.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:46:21 user nova-compute[74241]:   <uuid>333dae7f-9914-4604-a36b-8e5d4d2a4bce</uuid>
Oct 20 11:46:21 user nova-compute[74241]:   <name>instance-00000013</name>
Oct 20 11:46:21 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:46:21 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:46:21 user nova-compute[74241]:   <metadata>
Oct 20 11:46:21 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:46:21 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:46:21 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeTestJSON-server-1214393435</nova:name>
Oct 20 11:46:21 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:46:20</nova:creationTime>
Oct 20 11:46:21 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:46:21 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:46:21 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:46:21 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:46:21 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:46:21 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:46:21 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:46:21 user nova-compute[74241]:       <nova:owner>
Oct 20 11:46:21 user nova-compute[74241]:         <nova:user uuid="8f2c95648d124219b0505d18ebc85f5d">tempest-AttachVolumeTestJSON-1958556215-project-member</nova:user>
Oct 20 11:46:21 user nova-compute[74241]:         <nova:project uuid="2181a0d9a273487eaa81ad8acd48c8e9">tempest-AttachVolumeTestJSON-1958556215</nova:project>
Oct 20 11:46:21 user nova-compute[74241]:       </nova:owner>
Oct 20 11:46:21 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:46:21 user nova-compute[74241]:       <nova:ports>
Oct 20 11:46:21 user nova-compute[74241]:         <nova:port uuid="d970e2bd-a050-4038-afec-cb86392153c9">
Oct 20 11:46:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 11:46:21 user nova-compute[74241]:         </nova:port>
Oct 20 11:46:21 user nova-compute[74241]:       </nova:ports>
Oct 20 11:46:21 user nova-compute[74241]:     </nova:instance>
Oct 20 11:46:21 user nova-compute[74241]:   </metadata>
Oct 20 11:46:21 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:46:21 user nova-compute[74241]:     <system>
Oct 20 11:46:21 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:46:21 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:46:21 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:46:21 user nova-compute[74241]:       <entry name="serial">333dae7f-9914-4604-a36b-8e5d4d2a4bce</entry>
Oct 20 11:46:21 user nova-compute[74241]:       <entry name="uuid">333dae7f-9914-4604-a36b-8e5d4d2a4bce</entry>
Oct 20 11:46:21 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:46:21 user nova-compute[74241]:     </system>
Oct 20 11:46:21 user nova-compute[74241]:   </sysinfo>
Oct 20 11:46:21 user nova-compute[74241]:   <os>
Oct 20 11:46:21 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:46:21 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:46:21 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:46:21 user nova-compute[74241]:   </os>
Oct 20 11:46:21 user nova-compute[74241]:   <features>
Oct 20 11:46:21 user nova-compute[74241]:     <acpi/>
Oct 20 11:46:21 user nova-compute[74241]:     <apic/>
Oct 20 11:46:21 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:46:21 user nova-compute[74241]:   </features>
Oct 20 11:46:21 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:46:21 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:46:21 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:46:21 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:46:21 user nova-compute[74241]:   </clock>
Oct 20 11:46:21 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:46:21 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:46:21 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:46:21 user nova-compute[74241]:   </cpu>
Oct 20 11:46:21 user nova-compute[74241]:   <devices>
Oct 20 11:46:21 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:46:21 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:46:21 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk"/>
Oct 20 11:46:21 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:46:21 user nova-compute[74241]:     </disk>
Oct 20 11:46:21 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:46:21 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:46:21 user nova-compute[74241]:       <source dev="/dev/sdc"/>
Oct 20 11:46:21 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:46:21 user nova-compute[74241]:       <serial>a6a2a855-9804-4cce-ab2a-79a4cbe45293</serial>
Oct 20 11:46:21 user nova-compute[74241]:     </disk>
Oct 20 11:46:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:46:21 user nova-compute[74241]:       <mac address="fa:16:3e:4d:4b:43"/>
Oct 20 11:46:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:46:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:46:21 user nova-compute[74241]:       <target dev="tapd970e2bd-a0"/>
Oct 20 11:46:21 user nova-compute[74241]:     </interface>
Oct 20 11:46:21 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:46:21 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/console.log" append="off"/>
Oct 20 11:46:21 user nova-compute[74241]:     </serial>
Oct 20 11:46:21 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:46:21 user nova-compute[74241]:     <video>
Oct 20 11:46:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:46:21 user nova-compute[74241]:     </video>
Oct 20 11:46:21 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:46:21 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:46:21 user nova-compute[74241]:     </rng>
Oct 20 11:46:21 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:46:21 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:46:21 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:46:21 user nova-compute[74241]:     </memballoon>
Oct 20 11:46:21 user nova-compute[74241]:   </devices>
Oct 20 11:46:21 user nova-compute[74241]: </domain>
Oct 20 11:46:21 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:46:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.objects.instance [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'trusted_certs' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.objects.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-e973cb6c-1801-433d-a302-0e17b2b2df67 req-89e974e0-145f-4f4c-a4c9-143da1fe52b1 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received event network-vif-deleted-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:22 user nova-compute[74241]: INFO nova.compute.manager [req-e973cb6c-1801-433d-a302-0e17b2b2df67 req-89e974e0-145f-4f4c-a4c9-143da1fe52b1 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Neutron deleted interface bfe47f4d-715c-460b-ae2a-b038484d38ff; detaching it from the instance and deleting it from the info cache
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.network.neutron [req-e973cb6c-1801-433d-a302-0e17b2b2df67 req-89e974e0-145f-4f4c-a4c9-143da1fe52b1 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:46:22 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Took 1.32 seconds to deallocate network for instance.
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.228s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-ab1a9e85-ec06-43e8-876b-da4a3ad598c2 req-f9408f04-9ebd-4e1a-b370-fb98fbb6fef3 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received event network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ab1a9e85-ec06-43e8-876b-da4a3ad598c2 req-f9408f04-9ebd-4e1a-b370-fb98fbb6fef3 service nova] Acquiring lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ab1a9e85-ec06-43e8-876b-da4a3ad598c2 req-f9408f04-9ebd-4e1a-b370-fb98fbb6fef3 service nova] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ab1a9e85-ec06-43e8-876b-da4a3ad598c2 req-f9408f04-9ebd-4e1a-b370-fb98fbb6fef3 service nova] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-ab1a9e85-ec06-43e8-876b-da4a3ad598c2 req-f9408f04-9ebd-4e1a-b370-fb98fbb6fef3 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] No waiting events found dispatching network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:46:22 user nova-compute[74241]: WARNING nova.compute.manager [req-ab1a9e85-ec06-43e8-876b-da4a3ad598c2 req-f9408f04-9ebd-4e1a-b370-fb98fbb6fef3 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Received unexpected event network-vif-plugged-bfe47f4d-715c-460b-ae2a-b038484d38ff for instance with vm_state active and task_state deleting.
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-e973cb6c-1801-433d-a302-0e17b2b2df67 req-89e974e0-145f-4f4c-a4c9-143da1fe52b1 service nova] [instance: cf1199a8-5ce6-4778-a8e3-5eb176adde34] Detach interface failed, port_id=bfe47f4d-715c-460b-ae2a-b038484d38ff, reason: Instance cf1199a8-5ce6-4778-a8e3-5eb176adde34 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Cannot resize image /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.objects.instance [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'migration_context' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.objects.base [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG os_vif [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb8e2e0b-e8cf-527f-bbf2-270b077c0895', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd970e2bd-a0, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd970e2bd-a0, col_values=(('qos', UUID('0a2e0b0f-6d1d-43e2-bce9-0b8589615c0e')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd970e2bd-a0, col_values=(('external_ids', {'iface-id': 'd970e2bd-a050-4038-afec-cb86392153c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:4b:43', 'vm-uuid': '333dae7f-9914-4604-a36b-8e5d4d2a4bce'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:46:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:22 user nova-compute[74241]: INFO os_vif [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0')
Oct 20 11:46:23 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:46:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:46:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:23 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Deleted allocations for instance cf1199a8-5ce6-4778-a8e3-5eb176adde34
Oct 20 11:46:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ba8e5870-1d73-4424-98e3-538ba28c0c08 tempest-TestServerVolumeAttachScenarioOldVersion-801770068 tempest-TestServerVolumeAttachScenarioOldVersion-801770068-project-member] Lock "cf1199a8-5ce6-4778-a8e3-5eb176adde34" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.941s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-66c394db-4e75-4c5c-b53a-4dc94f981c59 req-71518802-b6c4-4d08-9b11-e37238093c32 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-66c394db-4e75-4c5c-b53a-4dc94f981c59 req-71518802-b6c4-4d08-9b11-e37238093c32 service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-66c394db-4e75-4c5c-b53a-4dc94f981c59 req-71518802-b6c4-4d08-9b11-e37238093c32 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-66c394db-4e75-4c5c-b53a-4dc94f981c59 req-71518802-b6c4-4d08-9b11-e37238093c32 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-66c394db-4e75-4c5c-b53a-4dc94f981c59 req-71518802-b6c4-4d08-9b11-e37238093c32 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:46:24 user nova-compute[74241]: WARNING nova.compute.manager [req-66c394db-4e75-4c5c-b53a-4dc94f981c59 req-71518802-b6c4-4d08-9b11-e37238093c32 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state stopped and task_state powering-on.
Oct 20 11:46:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-5ab88db3-c89b-4d89-b86e-c63e37c27007 req-e38ae2a3-2b68-42ed-95a4-276980845432 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ab88db3-c89b-4d89-b86e-c63e37c27007 req-e38ae2a3-2b68-42ed-95a4-276980845432 service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ab88db3-c89b-4d89-b86e-c63e37c27007 req-e38ae2a3-2b68-42ed-95a4-276980845432 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ab88db3-c89b-4d89-b86e-c63e37c27007 req-e38ae2a3-2b68-42ed-95a4-276980845432 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-5ab88db3-c89b-4d89-b86e-c63e37c27007 req-e38ae2a3-2b68-42ed-95a4-276980845432 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:46:26 user nova-compute[74241]: WARNING nova.compute.manager [req-5ab88db3-c89b-4d89-b86e-c63e37c27007 req-e38ae2a3-2b68-42ed-95a4-276980845432 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state stopped and task_state powering-on.
Oct 20 11:46:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:46:26 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance rebooted successfully.
Oct 20 11:46:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-119888fc-43e2-443c-82ac-4a469d944bdc tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:46:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-a6ec173e-9d56-4cb5-b239-c9f54c975cab req-4f8545ab-fab3-419b-bbaa-ba10ac5197b8 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received event network-changed-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:46:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-a6ec173e-9d56-4cb5-b239-c9f54c975cab req-4f8545ab-fab3-419b-bbaa-ba10ac5197b8 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Refreshing instance network info cache due to event network-changed-91c8f08e-494c-469d-8dd8-5d5a387b8534. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:46:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a6ec173e-9d56-4cb5-b239-c9f54c975cab req-4f8545ab-fab3-419b-bbaa-ba10ac5197b8 service nova] Acquiring lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:46:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a6ec173e-9d56-4cb5-b239-c9f54c975cab req-4f8545ab-fab3-419b-bbaa-ba10ac5197b8 service nova] Acquired lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:46:40 user nova-compute[74241]: DEBUG nova.network.neutron [req-a6ec173e-9d56-4cb5-b239-c9f54c975cab req-4f8545ab-fab3-419b-bbaa-ba10ac5197b8 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Refreshing network info cache for port 91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:46:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-a6ec173e-9d56-4cb5-b239-c9f54c975cab req-4f8545ab-fab3-419b-bbaa-ba10ac5197b8 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Updated VIF entry in instance network info cache for port 91c8f08e-494c-469d-8dd8-5d5a387b8534. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:46:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-a6ec173e-9d56-4cb5-b239-c9f54c975cab req-4f8545ab-fab3-419b-bbaa-ba10ac5197b8 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Updating instance_info_cache with network_info: [{"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:46:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a6ec173e-9d56-4cb5-b239-c9f54c975cab req-4f8545ab-fab3-419b-bbaa-ba10ac5197b8 service nova] Releasing lock "refresh_cache-7d253e72-22d1-4bf2-be00-69c298bfe1d3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:46:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:50 user nova-compute[74241]: DEBUG nova.objects.instance [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 7d253e72-22d1-4bf2-be00-69c298bfe1d3 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:46:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:51 user nova-compute[74241]: INFO nova.compute.manager [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Attaching volume b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 to /dev/vdb
Oct 20 11:46:51 user nova-compute[74241]: DEBUG os_brick.utils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a393869-7614-4eae-9786-497ad818346d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e791386e-d70f-4a9f-b57c-a94545e909e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[764b54ce-2324-485e-bd4b-d6b26936a805]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac36447c-04be-48e5-b577-e697d0cab2fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:46:51 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:46:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d249c2-0e6f-48bc-9a34-a05d7092ede5]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG os_brick.utils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:46:51 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Updating existing volume attachment record: 20772645-8b63-4956-8a2e-53a12d31be16 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:46:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:46:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:46:55 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:46:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:46:55 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:46:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:46:55 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:46:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:46:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:46:59 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:46:59 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7772MB free_disk=25.47030258178711GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5600826e-10a2-4079-bb18-a652aa279f45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:46:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:47:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:47:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:47:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:47:01 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating instance_info_cache with network_info: [{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:47:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:47:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:47:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:47:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:47:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:47:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:47:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:03 user nova-compute[74241]: INFO nova.compute.manager [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Rescuing
Oct 20 11:47:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:47:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquired lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:47:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updating instance_info_cache with network_info: [{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Releasing lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-3e2d5876-8b72-4aca-aa58-aa9fe81efd97 req-ed436559-dda0-4bf1-84ff-1f160a7e6a34 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3e2d5876-8b72-4aca-aa58-aa9fe81efd97 req-ed436559-dda0-4bf1-84ff-1f160a7e6a34 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3e2d5876-8b72-4aca-aa58-aa9fe81efd97 req-ed436559-dda0-4bf1-84ff-1f160a7e6a34 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3e2d5876-8b72-4aca-aa58-aa9fe81efd97 req-ed436559-dda0-4bf1-84ff-1f160a7e6a34 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-3e2d5876-8b72-4aca-aa58-aa9fe81efd97 req-ed436559-dda0-4bf1-84ff-1f160a7e6a34 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:47:04 user nova-compute[74241]: WARNING nova.compute.manager [req-3e2d5876-8b72-4aca-aa58-aa9fe81efd97 req-ed436559-dda0-4bf1-84ff-1f160a7e6a34 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state active and task_state rescuing.
Oct 20 11:47:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance destroyed successfully.
Oct 20 11:47:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Attempting rescue
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance directory exists: not creating {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 11:47:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Creating image(s)
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'trusted_certs' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.rescue {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.rescue" returned: 0 in 0.046s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'migration_context' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.base [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<031a2001-57b8-4411-bed1-69eac953d40b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Start _get_guest_xml network_info=[{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:a8:7e:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'resources' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.base [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<031a2001-57b8-4411-bed1-69eac953d40b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'numa_topology' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.base [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<031a2001-57b8-4411-bed1-69eac953d40b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:47:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:47:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'vcpu_model' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.base [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<031a2001-57b8-4411-bed1-69eac953d40b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1839366464',display_name='tempest-ServerRescueNegativeTestJSON-server-1839366464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1839366464',id=20,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-w5380cy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:42:22Z,user_data=None,user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=031a2001-57b8-4411-bed1-69eac953d40b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:a8:7e:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:a8:7e:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:7e:75,bridge_name='br-int',has_traffic_filtering=True,id=9193aa87-6409-4548-812c-31bbc6605398,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9193aa87-64') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'pci_devices' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.objects.base [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<031a2001-57b8-4411-bed1-69eac953d40b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:47:05 user nova-compute[74241]:   <uuid>031a2001-57b8-4411-bed1-69eac953d40b</uuid>
Oct 20 11:47:05 user nova-compute[74241]:   <name>instance-00000014</name>
Oct 20 11:47:05 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:47:05 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:47:05 user nova-compute[74241]:   <metadata>
Oct 20 11:47:05 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:47:05 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:47:05 user nova-compute[74241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1839366464</nova:name>
Oct 20 11:47:05 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:47:05</nova:creationTime>
Oct 20 11:47:05 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:47:05 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:47:05 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:47:05 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:47:05 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:47:05 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:47:05 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:47:05 user nova-compute[74241]:       <nova:owner>
Oct 20 11:47:05 user nova-compute[74241]:         <nova:user uuid="6ad19e5d57684ea2ae450fcc53ca8bd7">tempest-ServerRescueNegativeTestJSON-1505666936-project-member</nova:user>
Oct 20 11:47:05 user nova-compute[74241]:         <nova:project uuid="6b379f1e29f94071a26728bdb59bbfcb">tempest-ServerRescueNegativeTestJSON-1505666936</nova:project>
Oct 20 11:47:05 user nova-compute[74241]:       </nova:owner>
Oct 20 11:47:05 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:47:05 user nova-compute[74241]:       <nova:ports>
Oct 20 11:47:05 user nova-compute[74241]:         <nova:port uuid="9193aa87-6409-4548-812c-31bbc6605398">
Oct 20 11:47:05 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:47:05 user nova-compute[74241]:         </nova:port>
Oct 20 11:47:05 user nova-compute[74241]:       </nova:ports>
Oct 20 11:47:05 user nova-compute[74241]:     </nova:instance>
Oct 20 11:47:05 user nova-compute[74241]:   </metadata>
Oct 20 11:47:05 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:47:05 user nova-compute[74241]:     <system>
Oct 20 11:47:05 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:47:05 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:47:05 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:47:05 user nova-compute[74241]:       <entry name="serial">031a2001-57b8-4411-bed1-69eac953d40b</entry>
Oct 20 11:47:05 user nova-compute[74241]:       <entry name="uuid">031a2001-57b8-4411-bed1-69eac953d40b</entry>
Oct 20 11:47:05 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:47:05 user nova-compute[74241]:     </system>
Oct 20 11:47:05 user nova-compute[74241]:   </sysinfo>
Oct 20 11:47:05 user nova-compute[74241]:   <os>
Oct 20 11:47:05 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:47:05 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:47:05 user nova-compute[74241]:   </os>
Oct 20 11:47:05 user nova-compute[74241]:   <features>
Oct 20 11:47:05 user nova-compute[74241]:     <acpi/>
Oct 20 11:47:05 user nova-compute[74241]:     <apic/>
Oct 20 11:47:05 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:47:05 user nova-compute[74241]:   </features>
Oct 20 11:47:05 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:47:05 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:47:05 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:47:05 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:47:05 user nova-compute[74241]:   </clock>
Oct 20 11:47:05 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:47:05 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:47:05 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:47:05 user nova-compute[74241]:   </cpu>
Oct 20 11:47:05 user nova-compute[74241]:   <devices>
Oct 20 11:47:05 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:47:05 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:47:05 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.rescue"/>
Oct 20 11:47:05 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:47:05 user nova-compute[74241]:     </disk>
Oct 20 11:47:05 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:47:05 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:47:05 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk"/>
Oct 20 11:47:05 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:47:05 user nova-compute[74241]:     </disk>
Oct 20 11:47:05 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:47:05 user nova-compute[74241]:       <mac address="fa:16:3e:a8:7e:75"/>
Oct 20 11:47:05 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:47:05 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:47:05 user nova-compute[74241]:       <target dev="tap9193aa87-64"/>
Oct 20 11:47:05 user nova-compute[74241]:     </interface>
Oct 20 11:47:05 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:47:05 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/console.log" append="off"/>
Oct 20 11:47:05 user nova-compute[74241]:     </serial>
Oct 20 11:47:05 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:47:05 user nova-compute[74241]:     <video>
Oct 20 11:47:05 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:47:05 user nova-compute[74241]:     </video>
Oct 20 11:47:05 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:47:05 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:47:05 user nova-compute[74241]:     </rng>
Oct 20 11:47:05 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:47:05 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:47:05 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:47:05 user nova-compute[74241]:     </memballoon>
Oct 20 11:47:05 user nova-compute[74241]:   </devices>
Oct 20 11:47:05 user nova-compute[74241]: </domain>
Oct 20 11:47:05 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:47:05 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance destroyed successfully.
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:47:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No VIF found with MAC fa:16:3e:a8:7e:75, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:47:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-13c52efb-95af-443b-bb00-4bac8c8e57bf req-c8d9a659-ebaa-444b-8189-ca865d2ae438 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:47:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-13c52efb-95af-443b-bb00-4bac8c8e57bf req-c8d9a659-ebaa-444b-8189-ca865d2ae438 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-13c52efb-95af-443b-bb00-4bac8c8e57bf req-c8d9a659-ebaa-444b-8189-ca865d2ae438 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-13c52efb-95af-443b-bb00-4bac8c8e57bf req-c8d9a659-ebaa-444b-8189-ca865d2ae438 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-13c52efb-95af-443b-bb00-4bac8c8e57bf req-c8d9a659-ebaa-444b-8189-ca865d2ae438 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:47:07 user nova-compute[74241]: WARNING nova.compute.manager [req-13c52efb-95af-443b-bb00-4bac8c8e57bf req-c8d9a659-ebaa-444b-8189-ca865d2ae438 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state active and task_state rescuing.
Oct 20 11:47:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:47:09 user nova-compute[74241]: WARNING nova.compute.manager [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state active and task_state rescuing.
Oct 20 11:47:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:47:09 user nova-compute[74241]: WARNING nova.compute.manager [req-6f4e1e66-b999-453d-82d4-1f0ea78ebdcc req-95c00e96-52ee-4997-b09f-d62c17357ce9 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state active and task_state rescuing.
Oct 20 11:47:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-41a0009e-9fcb-47f9-bbc8-8c161955768c tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:47:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-765b00cc-dbea-412d-9285-efde5a223f08 req-b76ad234-0e50-4751-a47c-c8022622897b service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-changed-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:47:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-765b00cc-dbea-412d-9285-efde5a223f08 req-b76ad234-0e50-4751-a47c-c8022622897b service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Refreshing instance network info cache due to event network-changed-504064ac-206b-4ceb-9eb0-e87b8bfee408. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:47:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-765b00cc-dbea-412d-9285-efde5a223f08 req-b76ad234-0e50-4751-a47c-c8022622897b service nova] Acquiring lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:47:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-765b00cc-dbea-412d-9285-efde5a223f08 req-b76ad234-0e50-4751-a47c-c8022622897b service nova] Acquired lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:47:40 user nova-compute[74241]: DEBUG nova.network.neutron [req-765b00cc-dbea-412d-9285-efde5a223f08 req-b76ad234-0e50-4751-a47c-c8022622897b service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Refreshing network info cache for port 504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:47:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-765b00cc-dbea-412d-9285-efde5a223f08 req-b76ad234-0e50-4751-a47c-c8022622897b service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updated VIF entry in instance network info cache for port 504064ac-206b-4ceb-9eb0-e87b8bfee408. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:47:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-765b00cc-dbea-412d-9285-efde5a223f08 req-b76ad234-0e50-4751-a47c-c8022622897b service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:47:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-765b00cc-dbea-412d-9285-efde5a223f08 req-b76ad234-0e50-4751-a47c-c8022622897b service nova] Releasing lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Stashing vm_state: active {{(pid=74241) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:47:42 user nova-compute[74241]: INFO nova.compute.claims [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Claim successful on node user
Oct 20 11:47:42 user nova-compute[74241]: INFO nova.compute.resource_tracker [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating resource usage from migration 686ac838-dea4-4426-b7f5-e0116a32ff2c
Oct 20 11:47:42 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-94df288c-341f-407c-8d16-faa5e43e6e77 req-70574e22-872c-40d6-87cf-aeba055351b1 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-changed-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-94df288c-341f-407c-8d16-faa5e43e6e77 req-70574e22-872c-40d6-87cf-aeba055351b1 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Refreshing instance network info cache due to event network-changed-cc29a2ea-992b-40bd-a9fe-dc880128123a. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-94df288c-341f-407c-8d16-faa5e43e6e77 req-70574e22-872c-40d6-87cf-aeba055351b1 service nova] Acquiring lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-94df288c-341f-407c-8d16-faa5e43e6e77 req-70574e22-872c-40d6-87cf-aeba055351b1 service nova] Acquired lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-94df288c-341f-407c-8d16-faa5e43e6e77 req-70574e22-872c-40d6-87cf-aeba055351b1 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Refreshing network info cache for port cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.476s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:42 user nova-compute[74241]: INFO nova.compute.manager [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Migrating
Oct 20 11:47:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:47:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-94df288c-341f-407c-8d16-faa5e43e6e77 req-70574e22-872c-40d6-87cf-aeba055351b1 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updated VIF entry in instance network info cache for port cc29a2ea-992b-40bd-a9fe-dc880128123a. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:47:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-94df288c-341f-407c-8d16-faa5e43e6e77 req-70574e22-872c-40d6-87cf-aeba055351b1 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating instance_info_cache with network_info: [{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:47:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-94df288c-341f-407c-8d16-faa5e43e6e77 req-70574e22-872c-40d6-87cf-aeba055351b1 service nova] Releasing lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:47:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquired lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:47:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating instance_info_cache with network_info: [{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Releasing lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Starting migrate_disk_and_power_off {{(pid=74241) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-unplugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] No waiting events found dispatching network-vif-unplugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:47:44 user nova-compute[74241]: WARNING nova.compute.manager [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received unexpected event network-vif-unplugged-cc29a2ea-992b-40bd-a9fe-dc880128123a for instance with vm_state active and task_state resize_migrating.
Oct 20 11:47:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] No waiting events found dispatching network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:47:44 user nova-compute[74241]: WARNING nova.compute.manager [req-eb6685c5-df02-4d16-bfa2-049b3a2636da req-33275a1a-0a39-493a-8ceb-7077d00e22f4 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received unexpected event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a for instance with vm_state active and task_state resize_migrating.
Oct 20 11:47:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIgJPGdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:47:45 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:47:45 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:47:45 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[663a4ba5-7256-4969-84cb-778bad45bf30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:47:45 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d9dcec-1aed-43b7-a356-6601ff3783e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2] added
Oct 20 11:47:45 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879676d-4d79-4e05-8395-835738c82c9e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c0f6bd-9a32-4c78-b1bb-ccc27aa5be80]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIgJPGdO {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIgJPGdO" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5974f6d2-cdf8-4c6b-8d0b-9ed27ea51bae]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wIgJPGdO'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[219db29a-caa7-4793-bbdd-2f572eddf188]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance destroyed successfully.
Oct 20 11:47:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1668348691',display_name='tempest-ServerActionsTestOtherA-server-1668348691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1668348691',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-yx7a60yo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=ec07982b-d7ea-4950-aca1-c6120927cfb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1505262196-network", "vif_mac": "fa:16:3e:ea:5c:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1505262196-network", "vif_mac": "fa:16:3e:ea:5c:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_vif [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc29a2ea-99, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70575cb8-bdd3-426b-a12d-e11d2714aeb6) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7539e11d-ffd6-4917-99fd-d08f88dd7aa6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:47:45 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:47:45 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:47:45 user nova-compute[74241]: INFO os_vif [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99')
Oct 20 11:47:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQwNjaDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:47:45 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc4a230-8629-4a46-956a-0e80bb01d850]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2, portal: 172.16.0.220,3260]
Oct 20 11:47:45 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2, portal: 172.16.0.220,3260] successful.
Oct 20 11:47:45 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2556178c-6eff-4a8d-9c1e-a70becb36d83]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0950bce4-8551-425b-b7ea-5508a34cfc94]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)
Oct 20 11:47:45 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:47:45 user nova-compute[74241]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)
Oct 20 11:47:45 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e225e7-b33c-44d5-9105-e30817cf426c]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:47:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIgJPGdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26536626338643334', 'path': '/dev/sde'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536626338643334', 'path': '/dev/sde'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.147s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG nova.objects.instance [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 7d253e72-22d1-4bf2-be00-69c298bfe1d3 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c131d359-b039-420b-b06e-f0a18be3ce03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:47:46 user nova-compute[74241]: No targets found.
Oct 20 11:47:46 user nova-compute[74241]: iSNS:
Oct 20 11:47:46 user nova-compute[74241]: No targets found.
Oct 20 11:47:46 user nova-compute[74241]: STATIC:
Oct 20 11:47:46 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2
Oct 20 11:47:46 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:47:46 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:47:46 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a
Oct 20 11:47:46 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:47:46 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:47:46 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c
Oct 20 11:47:46 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:47:46 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:47:46 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293
Oct 20 11:47:46 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:47:46 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:47:46 user nova-compute[74241]: FIRMWARE:
Oct 20 11:47:46 user nova-compute[74241]: No targets found.
Oct 20 11:47:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:47:46 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:47:46 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:47:46 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:47:46 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:47:46 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:47:46 user nova-compute[74241]:   <serial>b70778c4-f7d9-4655-ac98-b4d8c8f0afa2</serial>
Oct 20 11:47:46 user nova-compute[74241]: </disk>
Oct 20 11:47:46 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7f7364-d5b4-43f5-af48-f836e9bb9602]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a118794e-ef9f-411e-8ddc-211fe5df2f7b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:47:46 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:47:46 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:47:46 user nova-compute[74241]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)
Oct 20 11:47:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:47:46 user nova-compute[74241]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:47:46 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:47:46 user nova-compute[74241]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)
Oct 20 11:47:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f524b789480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a'): ({'sdd'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Removing single pathed devices sdd {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90b55e1-9505-4719-8c8e-2dbb8e9bba53]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1daa23-2403-49a2-82d9-edc87ec70a4d]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flushing IO for device /dev/sdd {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97d7406-bd45-40b9-88b0-917743b7d3c4]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[248bc082-108e-4ff8-a6e0-297341b94e39]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[78712546-93c4-48a2-9037-d2ac57b401cd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf022c1e-84bc-4bb0-8a8b-b1fa7bea452f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260]
Oct 20 11:47:46 user nova-compute[74241]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260] successful.
Oct 20 11:47:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a5f14-055a-49dd-93d4-e7216922ff2c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== disconnect_volume: return (1498ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No VIF found with MAC fa:16:3e:ba:0a:91, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:47:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fa5fdeb9-b1ec-4ef3-8739-55d7511735fa tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 55.843s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:48 user nova-compute[74241]: INFO nova.compute.manager [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Detaching volume b70778c4-f7d9-4655-ac98-b4d8c8f0afa2
Oct 20 11:47:48 user nova-compute[74241]: INFO nova.virt.block_device [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Attempting to driver detach volume b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 from mountpoint /dev/vdb
Oct 20 11:47:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Attempting to detach device vdb from instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:47:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:47:48 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:47:48 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:47:48 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:47:48 user nova-compute[74241]:   <serial>b70778c4-f7d9-4655-ac98-b4d8c8f0afa2</serial>
Oct 20 11:47:48 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:47:48 user nova-compute[74241]: </disk>
Oct 20 11:47:48 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:47:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully detached device vdb from instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 from the persistent domain config.
Oct 20 11:47:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:47:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:47:48 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:47:48 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:47:48 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:47:48 user nova-compute[74241]:   <serial>b70778c4-f7d9-4655-ac98-b4d8c8f0afa2</serial>
Oct 20 11:47:48 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:47:48 user nova-compute[74241]: </disk>
Oct 20 11:47:48 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:47:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:47:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Port cc29a2ea-992b-40bd-a9fe-dc880128123a binding to destination host user is already ACTIVE {{(pid=74241) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquired lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating instance_info_cache with network_info: [{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Releasing lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG os_brick.utils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[24838e97-d431-4f39-b55d-ca6d0a61346d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[af276c15-16c6-4812-a258-22304e088016]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af32a1c-e748-4b46-a8fc-2a2956a2e60c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5eea82-3626-4062-8161-9467795c3644]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:47:55 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:47:55 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[640fd378-3081-422d-9219-67d8cd31faa7]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG os_brick.utils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:47:57 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:57 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:57 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:47:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:47:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:47:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:47:57 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:47:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:58 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:47:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:48:01 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:48:01 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7966MB free_disk=25.457477569580078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Applying migration context for instance ec07982b-d7ea-4950-aca1-c6120927cfb0 as it has an incoming, in-progress migration 686ac838-dea4-4426-b7f5-e0116a32ff2c. Migration status is post-migrating {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 11:48:01 user nova-compute[74241]: INFO nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating resource usage from migration 686ac838-dea4-4426-b7f5-e0116a32ff2c
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5600826e-10a2-4079-bb18-a652aa279f45 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Migration 686ac838-dea4-4426-b7f5-e0116a32ff2c is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:48:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:48:02 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:48:02 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:48:02 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:48:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updating instance_info_cache with network_info: [{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:03 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:48:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 is timed out.
Oct 20 11:48:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully detached device vdb from instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3 from the live domain config.
Oct 20 11:48:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIgJPGdO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:48:08 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9828f20-d357-4b3e-a77e-3cfc3048ac36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:48:08 user nova-compute[74241]: No targets found.
Oct 20 11:48:08 user nova-compute[74241]: iSNS:
Oct 20 11:48:08 user nova-compute[74241]: No targets found.
Oct 20 11:48:08 user nova-compute[74241]: STATIC:
Oct 20 11:48:08 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2
Oct 20 11:48:08 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:48:08 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:48:08 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c
Oct 20 11:48:08 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:48:08 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:48:08 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293
Oct 20 11:48:08 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:48:08 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:48:08 user nova-compute[74241]: FIRMWARE:
Oct 20 11:48:08 user nova-compute[74241]: No targets found.
Oct 20 11:48:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:48:08 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:48:08 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ae359-3677-4331-ae6c-4b30b6936cd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b8e271-4f2a-47ae-a5e7-017c2983ddb8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:48:08 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:48:08 user nova-compute[74241]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)
Oct 20 11:48:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:48:08 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:48:08 user nova-compute[74241]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 (non-flash)
Oct 20 11:48:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52087d09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2'): ({'sde'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Removing single pathed devices sde {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c77c4e6-4358-4d25-b47b-86c4046afe17]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b43de-b9a9-4c0a-8902-d9c493824a56]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flushing IO for device /dev/sde {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd6a501-ba73-4455-a28b-317713d36764]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c267e65-e9f8-4b4c-ac18-e9c13175f901]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6da92f-c38a-4c66-86d7-63c0dd55b961]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e61b72-0389-48e8-98ca-9eee9d360fb0]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2, portal: 172.16.0.220,3260]
Oct 20 11:48:09 user nova-compute[74241]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2, portal: 172.16.0.220,3260] successful.
Oct 20 11:48:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b70778c4-f7d9-4655-ac98-b4d8c8f0afa2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21e425d-6f4a-4214-b508-904de92ef086]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== disconnect_volume: return (334ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:48:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:48:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:10 user nova-compute[74241]: INFO nova.compute.manager [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Detaching volume a6a2a855-9804-4cce-ab2a-79a4cbe45293
Oct 20 11:48:11 user nova-compute[74241]: INFO nova.virt.block_device [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Attempting to driver detach volume a6a2a855-9804-4cce-ab2a-79a4cbe45293 from mountpoint /dev/vdb
Oct 20 11:48:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Attempting to detach device vdb from instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:48:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:48:11 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:48:11 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:48:11 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:48:11 user nova-compute[74241]:   <serial>a6a2a855-9804-4cce-ab2a-79a4cbe45293</serial>
Oct 20 11:48:11 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 11:48:11 user nova-compute[74241]: </disk>
Oct 20 11:48:11 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:48:11 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully detached device vdb from instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce from the persistent domain config.
Oct 20 11:48:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:48:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:48:11 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:48:11 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:48:11 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:48:11 user nova-compute[74241]:   <serial>a6a2a855-9804-4cce-ab2a-79a4cbe45293</serial>
Oct 20 11:48:11 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 11:48:11 user nova-compute[74241]: </disk>
Oct 20 11:48:11 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:48:11 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 7d253e72-22d1-4bf2-be00-69c298bfe1d3 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:48:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f952dd3f-92ff-492a-a21e-1a6b27246cd8 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.012s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:48:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:48:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:48:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:48:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:48:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:27 user nova-compute[74241]: INFO nova.compute.manager [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Terminating instance
Oct 20 11:48:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:48:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-251711d0-1044-411c-8566-97a2f95e8744 req-ab061779-15f5-4ede-aa61-82fe5a08a3f1 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-251711d0-1044-411c-8566-97a2f95e8744 req-ab061779-15f5-4ede-aa61-82fe5a08a3f1 service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-251711d0-1044-411c-8566-97a2f95e8744 req-ab061779-15f5-4ede-aa61-82fe5a08a3f1 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-251711d0-1044-411c-8566-97a2f95e8744 req-ab061779-15f5-4ede-aa61-82fe5a08a3f1 service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-251711d0-1044-411c-8566-97a2f95e8744 req-ab061779-15f5-4ede-aa61-82fe5a08a3f1 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-251711d0-1044-411c-8566-97a2f95e8744 req-ab061779-15f5-4ede-aa61-82fe5a08a3f1 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-unplugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:48:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Instance destroyed successfully.
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lazy-loading 'resources' on Instance uuid 5600826e-10a2-4079-bb18-a652aa279f45 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:40:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1518638015',display_name='tempest-ServerActionsTestOtherB-server-1518638015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1518638015',id=17,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5kISfWvSb5ExjtSI/OFotH9GYTVL1q+kE9/SJzd9ujnOdsE2Dk1NUj9NIay6ATYOvm3zDiOZwMvG3jrh9nma3cBiswbafsr7x6tU8WeggnYznnzqvF6a/np7INb8r+w==',key_name='tempest-keypair-806240299',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:46:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8956d1d704f54819b417cd6e5c7abd27',ramdisk_id='',reservation_id='r-vuurn2tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-805994491',owner_user_name='tempest-ServerActionsTestOtherB-805994491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0195b190e68a42be9877144bfe0cb277',uuid=5600826e-10a2-4079-bb18-a652aa279f45,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converting VIF {"id": "057c0964-5838-4c58-84aa-e479c46f8835", "address": "fa:16:3e:64:d9:51", "network": {"id": "6677b5ee-1f90-4918-951a-57c658af59ba", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1885854201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8956d1d704f54819b417cd6e5c7abd27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057c0964-58", "ovs_interfaceid": "057c0964-5838-4c58-84aa-e479c46f8835", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_vif [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap057c0964-58, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e93114f-fd40-45e9-81b9-4c5388866479) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:48:28 user nova-compute[74241]: INFO os_vif [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:d9:51,bridge_name='br-int',has_traffic_filtering=True,id=057c0964-5838-4c58-84aa-e479c46f8835,network=Network(6677b5ee-1f90-4918-951a-57c658af59ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057c0964-58')
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGnkeIfA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:48:28 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e9a330-e13e-411e-92c1-9d1df2d1418e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:48:28 user nova-compute[74241]: No targets found.
Oct 20 11:48:28 user nova-compute[74241]: iSNS:
Oct 20 11:48:28 user nova-compute[74241]: No targets found.
Oct 20 11:48:28 user nova-compute[74241]: STATIC:
Oct 20 11:48:28 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c
Oct 20 11:48:28 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:48:28 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:48:28 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293
Oct 20 11:48:28 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:48:28 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:48:28 user nova-compute[74241]: FIRMWARE:
Oct 20 11:48:28 user nova-compute[74241]: No targets found.
Oct 20 11:48:28 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:48:28 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:48:28 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3af0eb9-f86b-4072-bf5f-8705be9e64c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3785eb52-a9a1-488c-855c-b588bbde2301]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:48:28 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:48:28 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c (non-flash)
Oct 20 11:48:28 user nova-compute[74241]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:48:28 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52086c2290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf371b4-7cf0-4f59-a942-1310fb070a1b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afe44a4-f720-478a-a649-3226c72d9bb9]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff11f0e-8e83-4790-869c-560855b15187]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e379eb-6691-4857-af53-f189da9a5a3e]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a1ddf9-c7e1-4e85-a35c-9fdc60bed56d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79c2278-d50b-4502-bff0-f2c81be153e5]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260]
Oct 20 11:48:28 user nova-compute[74241]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c, portal: 172.16.0.220,3260] successful.
Oct 20 11:48:28 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afbcfb2c-1df6-496b-919f-a063331dc64c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63aebd4-be9b-41c9-b1bd-1673ba23d492]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] <== disconnect_volume: return (302ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:48:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Deleting instance files /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45_del
Oct 20 11:48:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Deletion of /opt/stack/data/nova/instances/5600826e-10a2-4079-bb18-a652aa279f45_del complete
Oct 20 11:48:28 user nova-compute[74241]: INFO nova.compute.manager [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 20 11:48:28 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:48:28 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:48:29 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:48:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-544f729d-4ef9-4d9e-b729-b992f9f62642 req-a2420924-dde7-4595-8f1b-a64169da10d7 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-deleted-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:29 user nova-compute[74241]: INFO nova.compute.manager [req-544f729d-4ef9-4d9e-b729-b992f9f62642 req-a2420924-dde7-4595-8f1b-a64169da10d7 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Neutron deleted interface 057c0964-5838-4c58-84aa-e479c46f8835; detaching it from the instance and deleting it from the info cache
Oct 20 11:48:29 user nova-compute[74241]: DEBUG nova.network.neutron [req-544f729d-4ef9-4d9e-b729-b992f9f62642 req-a2420924-dde7-4595-8f1b-a64169da10d7 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:48:29 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Took 0.73 seconds to deallocate network for instance.
Oct 20 11:48:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-544f729d-4ef9-4d9e-b729-b992f9f62642 req-a2420924-dde7-4595-8f1b-a64169da10d7 service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Detach interface failed, port_id=057c0964-5838-4c58-84aa-e479c46f8835, reason: Instance 5600826e-10a2-4079-bb18-a652aa279f45 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-626c5263-70c4-4912-9fff-958a2dce7a12 req-3a27ebfb-4deb-4971-ad16-97eeb4466eac service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-626c5263-70c4-4912-9fff-958a2dce7a12 req-3a27ebfb-4deb-4971-ad16-97eeb4466eac service nova] Acquiring lock "5600826e-10a2-4079-bb18-a652aa279f45-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-626c5263-70c4-4912-9fff-958a2dce7a12 req-3a27ebfb-4deb-4971-ad16-97eeb4466eac service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-626c5263-70c4-4912-9fff-958a2dce7a12 req-3a27ebfb-4deb-4971-ad16-97eeb4466eac service nova] Lock "5600826e-10a2-4079-bb18-a652aa279f45-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-626c5263-70c4-4912-9fff-958a2dce7a12 req-3a27ebfb-4deb-4971-ad16-97eeb4466eac service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] No waiting events found dispatching network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:30 user nova-compute[74241]: WARNING nova.compute.manager [req-626c5263-70c4-4912-9fff-958a2dce7a12 req-3a27ebfb-4deb-4971-ad16-97eeb4466eac service nova] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Received unexpected event network-vif-plugged-057c0964-5838-4c58-84aa-e479c46f8835 for instance with vm_state active and task_state deleting.
Oct 20 11:48:30 user nova-compute[74241]: INFO nova.compute.manager [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] [instance: 5600826e-10a2-4079-bb18-a652aa279f45] Took 0.86 seconds to detach 1 volumes for instance.
Oct 20 11:48:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:48:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:30 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Deleted allocations for instance 5600826e-10a2-4079-bb18-a652aa279f45
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4bd0285a-f9d1-40b8-8c24-1fab3c76cdd6 tempest-ServerActionsTestOtherB-805994491 tempest-ServerActionsTestOtherB-805994491-project-member] Lock "5600826e-10a2-4079-bb18-a652aa279f45" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.302s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:31 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce is timed out.
Oct 20 11:48:31 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully detached device vdb from instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce from the live domain config.
Oct 20 11:48:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LuAMeSbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:48:31 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[33446b51-7211-4726-b14b-10398267fc0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:48:31 user nova-compute[74241]: No targets found.
Oct 20 11:48:31 user nova-compute[74241]: iSNS:
Oct 20 11:48:31 user nova-compute[74241]: No targets found.
Oct 20 11:48:31 user nova-compute[74241]: STATIC:
Oct 20 11:48:31 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293
Oct 20 11:48:31 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:48:31 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:48:31 user nova-compute[74241]: FIRMWARE:
Oct 20 11:48:31 user nova-compute[74241]: No targets found.
Oct 20 11:48:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:48:31 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:48:31 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c5f6f9-6289-41a2-a4f1-75ac6c6410cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8294ed-2c09-4f99-8435-22a224a27c42]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:48:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 (non-flash)
Oct 20 11:48:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5228317520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[170458d8-ece3-4450-9327-b21b4b2537ce]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f073ee-7d23-478f-9c77-9550db8c072b]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[139f32eb-f09c-4156-8055-c93d05fa1318]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[446427e8-158f-4ce5-b098-7ce7215e52ee]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a9e224-3d7e-4d54-ac8e-e4388cb0b38e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9395f077-7570-444e-ae2c-04d4b75f772f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260]
Oct 20 11:48:31 user nova-compute[74241]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293, portal: 172.16.0.220,3260] successful.
Oct 20 11:48:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6a2a855-9804-4cce-ab2a-79a4cbe45293 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed4d3cc-acc5-4bf6-b29c-b748c304da5d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== disconnect_volume: return (299ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:48:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:48:32 user nova-compute[74241]: DEBUG nova.objects.instance [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:48:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-61a7c23a-c29e-4132-bcbd-4d9c4299d040 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.748s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-923e7c0d-0576-4d60-8007-fa8d8fda3419 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-923e7c0d-0576-4d60-8007-fa8d8fda3419 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-923e7c0d-0576-4d60-8007-fa8d8fda3419 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-923e7c0d-0576-4d60-8007-fa8d8fda3419 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74241) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG nova.objects.instance [None req-923e7c0d-0576-4d60-8007-fa8d8fda3419 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-20458adc-0d19-4e1a-a2c6-70a399f2a832 req-78213b35-2edf-4d5b-83f8-2d9c85d4cb1f service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-20458adc-0d19-4e1a-a2c6-70a399f2a832 req-78213b35-2edf-4d5b-83f8-2d9c85d4cb1f service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-20458adc-0d19-4e1a-a2c6-70a399f2a832 req-78213b35-2edf-4d5b-83f8-2d9c85d4cb1f service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-20458adc-0d19-4e1a-a2c6-70a399f2a832 req-78213b35-2edf-4d5b-83f8-2d9c85d4cb1f service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-20458adc-0d19-4e1a-a2c6-70a399f2a832 req-78213b35-2edf-4d5b-83f8-2d9c85d4cb1f service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:34 user nova-compute[74241]: WARNING nova.compute.manager [req-20458adc-0d19-4e1a-a2c6-70a399f2a832 req-78213b35-2edf-4d5b-83f8-2d9c85d4cb1f service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state active and task_state powering-off.
Oct 20 11:48:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance destroyed successfully.
Oct 20 11:48:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-923e7c0d-0576-4d60-8007-fa8d8fda3419 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:48:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-923e7c0d-0576-4d60-8007-fa8d8fda3419 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.839s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-a21070e5-c6e8-4f7c-a056-24ebb760a6b9 req-95443ee0-de47-493d-98ba-9ff298dfe28a service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a21070e5-c6e8-4f7c-a056-24ebb760a6b9 req-95443ee0-de47-493d-98ba-9ff298dfe28a service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a21070e5-c6e8-4f7c-a056-24ebb760a6b9 req-95443ee0-de47-493d-98ba-9ff298dfe28a service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a21070e5-c6e8-4f7c-a056-24ebb760a6b9 req-95443ee0-de47-493d-98ba-9ff298dfe28a service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-a21070e5-c6e8-4f7c-a056-24ebb760a6b9 req-95443ee0-de47-493d-98ba-9ff298dfe28a service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:36 user nova-compute[74241]: WARNING nova.compute.manager [req-a21070e5-c6e8-4f7c-a056-24ebb760a6b9 req-95443ee0-de47-493d-98ba-9ff298dfe28a service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state stopped and task_state None.
Oct 20 11:48:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:38 user nova-compute[74241]: INFO nova.compute.manager [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Terminating instance
Oct 20 11:48:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-71313d80-c9a3-45a8-8ae0-2fe2a7934316 req-27ef013a-56ef-41a5-ac16-deaedb9e3421 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received event network-vif-unplugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-71313d80-c9a3-45a8-8ae0-2fe2a7934316 req-27ef013a-56ef-41a5-ac16-deaedb9e3421 service nova] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-71313d80-c9a3-45a8-8ae0-2fe2a7934316 req-27ef013a-56ef-41a5-ac16-deaedb9e3421 service nova] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-71313d80-c9a3-45a8-8ae0-2fe2a7934316 req-27ef013a-56ef-41a5-ac16-deaedb9e3421 service nova] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-71313d80-c9a3-45a8-8ae0-2fe2a7934316 req-27ef013a-56ef-41a5-ac16-deaedb9e3421 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] No waiting events found dispatching network-vif-unplugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-71313d80-c9a3-45a8-8ae0-2fe2a7934316 req-27ef013a-56ef-41a5-ac16-deaedb9e3421 service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received event network-vif-unplugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:48:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Instance destroyed successfully.
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'resources' on Instance uuid 7d253e72-22d1-4bf2-be00-69c298bfe1d3 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:44:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1105658303',display_name='tempest-AttachVolumeNegativeTest-server-1105658303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1105658303',id=24,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs78lmk/fApLiOBy8wHY4Jb8USFKuymoiPVtqRELD/+x0ybYYuIzN/3s2dqyZYxVKaVbqTkOIUTUSubLvDBrcc+PhU3eVMiFc1fHXH9QS0GWg08FaieGqBs5OzgUgkN8w==',key_name='tempest-keypair-1678933620',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:44:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-0a7d0qiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=7d253e72-22d1-4bf2-be00-69c298bfe1d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "address": "fa:16:3e:ba:0a:91", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91c8f08e-49", "ovs_interfaceid": "91c8f08e-494c-469d-8dd8-5d5a387b8534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=91c8f08e-494c-469d-8dd8-5d5a387b8534,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c8f08e-49') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG os_vif [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=91c8f08e-494c-469d-8dd8-5d5a387b8534,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c8f08e-49') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91c8f08e-49, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91334322-a073-46cd-819d-8fa85daee097) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:39 user nova-compute[74241]: INFO os_vif [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:0a:91,bridge_name='br-int',has_traffic_filtering=True,id=91c8f08e-494c-469d-8dd8-5d5a387b8534,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91c8f08e-49')
Oct 20 11:48:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Deleting instance files /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3_del
Oct 20 11:48:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Deletion of /opt/stack/data/nova/instances/7d253e72-22d1-4bf2-be00-69c298bfe1d3_del complete
Oct 20 11:48:39 user nova-compute[74241]: INFO nova.compute.manager [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 11:48:39 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:48:39 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:48:40 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:48:40 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Took 0.65 seconds to deallocate network for instance.
Oct 20 11:48:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-16530c13-91e1-44d2-a4ce-439863abc69a req-433f3c8e-b94f-48ad-9484-ac628d1e498f service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received event network-vif-deleted-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:40 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:48:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:48:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:40 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Deleted allocations for instance 7d253e72-22d1-4bf2-be00-69c298bfe1d3
Oct 20 11:48:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d2dfa529-3b73-4274-ada6-9bd6ac85741d tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-69ae1003-5937-41ea-ae5d-275919579e5d req-33c29fb0-d032-4318-bc1b-41fba9547cca service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received event network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-69ae1003-5937-41ea-ae5d-275919579e5d req-33c29fb0-d032-4318-bc1b-41fba9547cca service nova] Acquiring lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-69ae1003-5937-41ea-ae5d-275919579e5d req-33c29fb0-d032-4318-bc1b-41fba9547cca service nova] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-69ae1003-5937-41ea-ae5d-275919579e5d req-33c29fb0-d032-4318-bc1b-41fba9547cca service nova] Lock "7d253e72-22d1-4bf2-be00-69c298bfe1d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-69ae1003-5937-41ea-ae5d-275919579e5d req-33c29fb0-d032-4318-bc1b-41fba9547cca service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] No waiting events found dispatching network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:41 user nova-compute[74241]: WARNING nova.compute.manager [req-69ae1003-5937-41ea-ae5d-275919579e5d req-33c29fb0-d032-4318-bc1b-41fba9547cca service nova] [instance: 7d253e72-22d1-4bf2-be00-69c298bfe1d3] Received unexpected event network-vif-plugged-91c8f08e-494c-469d-8dd8-5d5a387b8534 for instance with vm_state deleted and task_state None.
Oct 20 11:48:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:48:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 11:48:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 11:48:54 user nova-compute[74241]: INFO nova.compute.manager [None req-270b2e4f-fe8d-443c-b30f-37a8dab357ed tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Unrescuing
Oct 20 11:48:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-270b2e4f-fe8d-443c-b30f-37a8dab357ed tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:48:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-270b2e4f-fe8d-443c-b30f-37a8dab357ed tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquired lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:48:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-270b2e4f-fe8d-443c-b30f-37a8dab357ed tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG nova.network.neutron [None req-270b2e4f-fe8d-443c-b30f-37a8dab357ed tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updating instance_info_cache with network_info: [{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-270b2e4f-fe8d-443c-b30f-37a8dab357ed tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Releasing lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG nova.objects.instance [None req-270b2e4f-fe8d-443c-b30f-37a8dab357ed tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'flavor' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG nova.compute.manager [req-2bcc69cc-4fbf-4192-bc6c-c2fa04189176 req-fac1475c-1e51-4533-a61e-6fa45983192e service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bcc69cc-4fbf-4192-bc6c-c2fa04189176 req-fac1475c-1e51-4533-a61e-6fa45983192e service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bcc69cc-4fbf-4192-bc6c-c2fa04189176 req-fac1475c-1e51-4533-a61e-6fa45983192e service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bcc69cc-4fbf-4192-bc6c-c2fa04189176 req-fac1475c-1e51-4533-a61e-6fa45983192e service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:55 user nova-compute[74241]: DEBUG nova.compute.manager [req-2bcc69cc-4fbf-4192-bc6c-c2fa04189176 req-fac1475c-1e51-4533-a61e-6fa45983192e service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:55 user nova-compute[74241]: WARNING nova.compute.manager [req-2bcc69cc-4fbf-4192-bc6c-c2fa04189176 req-fac1475c-1e51-4533-a61e-6fa45983192e service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:48:55 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance destroyed successfully.
Oct 20 11:48:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:56 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:56 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:56 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:57 user nova-compute[74241]: WARNING nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:48:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:57 user nova-compute[74241]: WARNING nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:48:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:57 user nova-compute[74241]: DEBUG nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:48:57 user nova-compute[74241]: WARNING nova.compute.manager [req-81062460-44a7-42ba-a1b2-6ce5c02a39e5 req-0d80cd7c-4033-4c36-b423-a3e510175f21 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:48:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-270b2e4f-fe8d-443c-b30f-37a8dab357ed tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:48:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Starting finish_migration {{(pid=74241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance directory exists: not creating {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 11:49:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Creating image(s)
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Ensure instance console log exists: /opt/stack/data/nova/instances/ec07982b-d7ea-4950-aca1-c6120927cfb0/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Start _get_guest_xml network_info=[{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1505262196-network", "vif_mac": "fa:16:3e:ea:5c:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '8c14f98e-1e20-410f-80f3-bd62661872bb', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQwNjaDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ec07982b-d7ea-4950-aca1-c6120927cfb0', 'attached_at': '2023-10-20T11:49:00.000000', 'detached_at': '', 'volume_id': 'c73cbcf1-5531-4645-9169-696fb9e4106a', 'serial': 'c73cbcf1-5531-4645-9169-696fb9e4106a'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:49:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:29:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQwNjaDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:49:00 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:49:00 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:49:00 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa5e94-cece-42d1-9cca-35cb4461ff94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:49:00 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0a238e-334e-458e-9965-837a393a300c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a] added
Oct 20 11:49:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[be12869c-0d01-4b3e-902e-ca12c2317463]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[82869c2b-f688-4bef-8121-6722c6a5097b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQwNjaDF {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bQwNjaDF" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4afa52a-212b-4595-be87-b4ff0ea98f2e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bQwNjaDF'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7811bf3-5a8e-42b2-ac13-157313ad4d2f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[da117b64-d51f-4844-92b2-ce23e855cc61]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 11:49:00 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 11:49:00 user nova-compute[74241]:  {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:49:00 user nova-compute[74241]: WARNING os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 11:49:00 user nova-compute[74241]: 
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4982ed-bca3-4053-a565-d0d937f1fbfc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260]
Oct 20 11:49:00 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260] successful.
Oct 20 11:49:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b894759c-e8ff-4e3f-8424-024110d9f761]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d458c935-5792-40ce-962d-5c6422d18728]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:49:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:49:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc674bbf-4ffd-4125-a90a-a9a76519c837]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQwNjaDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23662376235636234', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662376235636234', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1668348691',display_name='tempest-ServerActionsTestOtherA-server-1668348691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1668348691',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-yx7a60yo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=ec07982b-d7ea-4950-aca1-c6120927cfb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1505262196-network", "vif_mac": "fa:16:3e:ea:5c:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1505262196-network", "vif_mac": "fa:16:3e:ea:5c:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:49:01 user nova-compute[74241]:   <uuid>ec07982b-d7ea-4950-aca1-c6120927cfb0</uuid>
Oct 20 11:49:01 user nova-compute[74241]:   <name>instance-00000019</name>
Oct 20 11:49:01 user nova-compute[74241]:   <memory>2097152</memory>
Oct 20 11:49:01 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:49:01 user nova-compute[74241]:   <metadata>
Oct 20 11:49:01 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:49:01 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:49:01 user nova-compute[74241]:       <nova:name>tempest-ServerActionsTestOtherA-server-1668348691</nova:name>
Oct 20 11:49:01 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:49:00</nova:creationTime>
Oct 20 11:49:01 user nova-compute[74241]:       <nova:flavor name="m1.small">
Oct 20 11:49:01 user nova-compute[74241]:         <nova:memory>2048</nova:memory>
Oct 20 11:49:01 user nova-compute[74241]:         <nova:disk>20</nova:disk>
Oct 20 11:49:01 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:49:01 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:49:01 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:49:01 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:49:01 user nova-compute[74241]:       <nova:owner>
Oct 20 11:49:01 user nova-compute[74241]:         <nova:user uuid="3d7605635edc4cf9bddad897b8c18b77">tempest-ServerActionsTestOtherA-1364765065-project-member</nova:user>
Oct 20 11:49:01 user nova-compute[74241]:         <nova:project uuid="f4449c61c4f64b2f96f4ac79b72c8f95">tempest-ServerActionsTestOtherA-1364765065</nova:project>
Oct 20 11:49:01 user nova-compute[74241]:       </nova:owner>
Oct 20 11:49:01 user nova-compute[74241]:       <nova:ports>
Oct 20 11:49:01 user nova-compute[74241]:         <nova:port uuid="cc29a2ea-992b-40bd-a9fe-dc880128123a">
Oct 20 11:49:01 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 11:49:01 user nova-compute[74241]:         </nova:port>
Oct 20 11:49:01 user nova-compute[74241]:       </nova:ports>
Oct 20 11:49:01 user nova-compute[74241]:     </nova:instance>
Oct 20 11:49:01 user nova-compute[74241]:   </metadata>
Oct 20 11:49:01 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:49:01 user nova-compute[74241]:     <system>
Oct 20 11:49:01 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:49:01 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:49:01 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:49:01 user nova-compute[74241]:       <entry name="serial">ec07982b-d7ea-4950-aca1-c6120927cfb0</entry>
Oct 20 11:49:01 user nova-compute[74241]:       <entry name="uuid">ec07982b-d7ea-4950-aca1-c6120927cfb0</entry>
Oct 20 11:49:01 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:49:01 user nova-compute[74241]:     </system>
Oct 20 11:49:01 user nova-compute[74241]:   </sysinfo>
Oct 20 11:49:01 user nova-compute[74241]:   <os>
Oct 20 11:49:01 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:49:01 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:49:01 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:49:01 user nova-compute[74241]:   </os>
Oct 20 11:49:01 user nova-compute[74241]:   <features>
Oct 20 11:49:01 user nova-compute[74241]:     <acpi/>
Oct 20 11:49:01 user nova-compute[74241]:     <apic/>
Oct 20 11:49:01 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:49:01 user nova-compute[74241]:   </features>
Oct 20 11:49:01 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:49:01 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:49:01 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:49:01 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:49:01 user nova-compute[74241]:   </clock>
Oct 20 11:49:01 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:49:01 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:49:01 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:49:01 user nova-compute[74241]:   </cpu>
Oct 20 11:49:01 user nova-compute[74241]:   <devices>
Oct 20 11:49:01 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:49:01 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:49:01 user nova-compute[74241]:       <source dev="/dev/sdb"/>
Oct 20 11:49:01 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:49:01 user nova-compute[74241]:       <serial>c73cbcf1-5531-4645-9169-696fb9e4106a</serial>
Oct 20 11:49:01 user nova-compute[74241]:     </disk>
Oct 20 11:49:01 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:49:01 user nova-compute[74241]:       <mac address="fa:16:3e:ea:5c:9e"/>
Oct 20 11:49:01 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:01 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:49:01 user nova-compute[74241]:       <target dev="tapcc29a2ea-99"/>
Oct 20 11:49:01 user nova-compute[74241]:     </interface>
Oct 20 11:49:01 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:49:01 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/ec07982b-d7ea-4950-aca1-c6120927cfb0/console.log" append="off"/>
Oct 20 11:49:01 user nova-compute[74241]:     </serial>
Oct 20 11:49:01 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:49:01 user nova-compute[74241]:     <video>
Oct 20 11:49:01 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:01 user nova-compute[74241]:     </video>
Oct 20 11:49:01 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:49:01 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:49:01 user nova-compute[74241]:     </rng>
Oct 20 11:49:01 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:49:01 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:49:01 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:49:01 user nova-compute[74241]:     </memballoon>
Oct 20 11:49:01 user nova-compute[74241]:   </devices>
Oct 20 11:49:01 user nova-compute[74241]: </domain>
Oct 20 11:49:01 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1668348691',display_name='tempest-ServerActionsTestOtherA-server-1668348691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1668348691',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-yx7a60yo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:47:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=ec07982b-d7ea-4950-aca1-c6120927cfb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1505262196-network", "vif_mac": "fa:16:3e:ea:5c:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1505262196-network", "vif_mac": "fa:16:3e:ea:5c:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG os_vif [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e4734e4-beb9-5ca2-b826-c1c458a6cb0a', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc29a2ea-99, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc29a2ea-99, col_values=(('qos', UUID('f6d1e782-a0fa-45f6-9399-c92b2ca4c03d')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc29a2ea-99, col_values=(('external_ids', {'iface-id': 'cc29a2ea-992b-40bd-a9fe-dc880128123a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:5c:9e', 'vm-uuid': 'ec07982b-d7ea-4950-aca1-c6120927cfb0'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:01 user nova-compute[74241]: INFO os_vif [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99')
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "df39a80e-8be5-4453-a0f3-866d00c27f65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:01 user nova-compute[74241]: INFO nova.compute.manager [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Terminating instance
Oct 20 11:49:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] No VIF found with MAC fa:16:3e:ea:5c:9e, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.228s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-81cb884d-dd70-4ffe-a0e8-b5af08092b01 req-3b2e8b5e-183b-404d-a122-fc13d0612973 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received event network-vif-unplugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81cb884d-dd70-4ffe-a0e8-b5af08092b01 req-3b2e8b5e-183b-404d-a122-fc13d0612973 service nova] Acquiring lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81cb884d-dd70-4ffe-a0e8-b5af08092b01 req-3b2e8b5e-183b-404d-a122-fc13d0612973 service nova] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-81cb884d-dd70-4ffe-a0e8-b5af08092b01 req-3b2e8b5e-183b-404d-a122-fc13d0612973 service nova] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-81cb884d-dd70-4ffe-a0e8-b5af08092b01 req-3b2e8b5e-183b-404d-a122-fc13d0612973 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] No waiting events found dispatching network-vif-unplugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-81cb884d-dd70-4ffe-a0e8-b5af08092b01 req-3b2e8b5e-183b-404d-a122-fc13d0612973 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received event network-vif-unplugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:03 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Instance destroyed successfully.
Oct 20 11:49:03 user nova-compute[74241]: DEBUG nova.objects.instance [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lazy-loading 'resources' on Instance uuid df39a80e-8be5-4453-a0f3-866d00c27f65 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1670218933',display_name='tempest-ServersNegativeTestJSON-server-1670218933',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1670218933',id=15,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:40:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a1a3993ce9641a5915b335135b32672',ramdisk_id='',reservation_id='r-dxw6x51w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-819929623',owner_user_name='tempest-ServersNegativeTestJSON-819929623-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:40:05Z,user_data=None,user_id='81bd4a77e2a545ab888a85c2e561ef04',uuid=df39a80e-8be5-4453-a0f3-866d00c27f65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converting VIF {"id": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "address": "fa:16:3e:d7:76:3f", "network": {"id": "a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1088500692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a1a3993ce9641a5915b335135b32672", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae87b6f8-ee", "ovs_interfaceid": "ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:76:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae87b6f8-ee') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG os_vif [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:76:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae87b6f8-ee') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae87b6f8-ee, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=290088d5-2e12-4336-a83d-eb49d0d21209) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:49:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:04 user nova-compute[74241]: INFO os_vif [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:76:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778,network=Network(a907440d-b7cb-4a10-b6f8-d2c5b8dfb2dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae87b6f8-ee')
Oct 20 11:49:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Deleting instance files /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65_del
Oct 20 11:49:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Deletion of /opt/stack/data/nova/instances/df39a80e-8be5-4453-a0f3-866d00c27f65_del complete
Oct 20 11:49:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-620b2cc0-03b1-4656-8b81-02068a582fe8 req-bb149583-8339-4169-95f5-f3a9c498d331 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received event network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-620b2cc0-03b1-4656-8b81-02068a582fe8 req-bb149583-8339-4169-95f5-f3a9c498d331 service nova] Acquiring lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-620b2cc0-03b1-4656-8b81-02068a582fe8 req-bb149583-8339-4169-95f5-f3a9c498d331 service nova] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-620b2cc0-03b1-4656-8b81-02068a582fe8 req-bb149583-8339-4169-95f5-f3a9c498d331 service nova] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-620b2cc0-03b1-4656-8b81-02068a582fe8 req-bb149583-8339-4169-95f5-f3a9c498d331 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] No waiting events found dispatching network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:06 user nova-compute[74241]: WARNING nova.compute.manager [req-620b2cc0-03b1-4656-8b81-02068a582fe8 req-bb149583-8339-4169-95f5-f3a9c498d331 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received unexpected event network-vif-plugged-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 for instance with vm_state active and task_state deleting.
Oct 20 11:49:06 user nova-compute[74241]: INFO nova.compute.manager [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Took 4.48 seconds to destroy the instance on the hypervisor.
Oct 20 11:49:06 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:49:06 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:06 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8464MB free_disk=25.501426696777344GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:06 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance running successfully.
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Failed to set time: agent not configured {{(pid=74241) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-40f159a6-0876-4683-b504-795bc6951bd8 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] finish_migration finished successfully. {{(pid=74241) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Applying migration context for instance ec07982b-d7ea-4950-aca1-c6120927cfb0 as it has an incoming, in-progress migration 686ac838-dea4-4426-b7f5-e0116a32ff2c. Migration status is post-migrating {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 11:49:06 user nova-compute[74241]: INFO nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating resource usage from migration 686ac838-dea4-4426-b7f5-e0116a32ff2c
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance df39a80e-8be5-4453-a0f3-866d00c27f65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Migration 686ac838-dea4-4426-b7f5-e0116a32ff2c is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 11:49:06 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.788s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-636dd6a9-64b5-435e-8621-782affb7e599 req-1e9d01cc-313f-4dcd-8322-bb2fdd314ce0 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-636dd6a9-64b5-435e-8621-782affb7e599 req-1e9d01cc-313f-4dcd-8322-bb2fdd314ce0 service nova] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-636dd6a9-64b5-435e-8621-782affb7e599 req-1e9d01cc-313f-4dcd-8322-bb2fdd314ce0 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-636dd6a9-64b5-435e-8621-782affb7e599 req-1e9d01cc-313f-4dcd-8322-bb2fdd314ce0 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-636dd6a9-64b5-435e-8621-782affb7e599 req-1e9d01cc-313f-4dcd-8322-bb2fdd314ce0 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] No waiting events found dispatching network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:07 user nova-compute[74241]: WARNING nova.compute.manager [req-636dd6a9-64b5-435e-8621-782affb7e599 req-1e9d01cc-313f-4dcd-8322-bb2fdd314ce0 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received unexpected event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a for instance with vm_state resized and task_state None.
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:07 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Took 1.11 seconds to deallocate network for instance.
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-8c8fb414-a5b7-4ed8-a6a9-92e599702be7 req-3d3ea2c9-4784-48e8-84d1-87b8e2e392a6 service nova] [instance: df39a80e-8be5-4453-a0f3-866d00c27f65] Received event network-vif-deleted-ae87b6f8-ee68-4f92-8ab3-59d0b4cd0778 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.011s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:49:07 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:08 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Deleted allocations for instance df39a80e-8be5-4453-a0f3-866d00c27f65
Oct 20 11:49:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9aebceed-7cdd-4211-922c-e425d7933132 tempest-ServersNegativeTestJSON-819929623 tempest-ServersNegativeTestJSON-819929623-project-member] Lock "df39a80e-8be5-4453-a0f3-866d00c27f65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.218s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updating instance_info_cache with network_info: [{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:49:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-39a14097-fe02-4f65-8451-e8cf5e2048d3 req-3063b7d0-17fe-420a-8c6c-bba64bec2e75 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39a14097-fe02-4f65-8451-e8cf5e2048d3 req-3063b7d0-17fe-420a-8c6c-bba64bec2e75 service nova] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39a14097-fe02-4f65-8451-e8cf5e2048d3 req-3063b7d0-17fe-420a-8c6c-bba64bec2e75 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39a14097-fe02-4f65-8451-e8cf5e2048d3 req-3063b7d0-17fe-420a-8c6c-bba64bec2e75 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-39a14097-fe02-4f65-8451-e8cf5e2048d3 req-3063b7d0-17fe-420a-8c6c-bba64bec2e75 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] No waiting events found dispatching network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:09 user nova-compute[74241]: WARNING nova.compute.manager [req-39a14097-fe02-4f65-8451-e8cf5e2048d3 req-3063b7d0-17fe-420a-8c6c-bba64bec2e75 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received unexpected event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a for instance with vm_state resized and task_state None.
Oct 20 11:49:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:49:17 user nova-compute[74241]: INFO nova.compute.claims [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Claim successful on node user
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:49:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:49:17 user nova-compute[74241]: DEBUG nova.policy [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd2b2cd84c5a403f868d69ccc7f8afc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137870b8216f4a49b1eecde3ec14b75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:49:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Creating image(s)
Oct 20 11:49:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "/opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "/opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "034ed09460dc7edc12324291985fe69e569f7dc0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "034ed09460dc7edc12324291985fe69e569f7dc0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0.part --force-share --output=json" returned: 0 in 0.216s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG nova.virt.images [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] 51d4a3aa-5eba-4773-bb5c-72300483f2dd was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0.part /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Successfully created port: b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0.part /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0.converted" returned: 0 in 0.301s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "034ed09460dc7edc12324291985fe69e569f7dc0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.263s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "034ed09460dc7edc12324291985fe69e569f7dc0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "034ed09460dc7edc12324291985fe69e569f7dc0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Successfully updated port: b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquired lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-9bf09016-eadc-45c1-802a-18766a18f60b req-f99a99b9-cbd0-421b-aee2-d94ad6374fd1 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-9bf09016-eadc-45c1-802a-18766a18f60b req-f99a99b9-cbd0-421b-aee2-d94ad6374fd1 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing instance network info cache due to event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9bf09016-eadc-45c1-802a-18766a18f60b req-f99a99b9-cbd0-421b-aee2-d94ad6374fd1 service nova] Acquiring lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 --force-share --output=json" returned: 0 in 0.220s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0,backing_fmt=raw /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0,backing_fmt=raw /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk 1073741824" returned: 0 in 0.063s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "034ed09460dc7edc12324291985fe69e569f7dc0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 --force-share --output=json" returned: 0 in 0.199s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:49:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating instance_info_cache with network_info: [{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Releasing lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Instance network_info: |[{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9bf09016-eadc-45c1-802a-18766a18f60b req-f99a99b9-cbd0-421b-aee2-d94ad6374fd1 service nova] Acquired lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-9bf09016-eadc-45c1-802a-18766a18f60b req-f99a99b9-cbd0-421b-aee2-d94ad6374fd1 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Cannot resize image /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Ensure instance console log exists: /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Start _get_guest_xml network_info=[{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:49:14Z,direct_url=<?>,disk_format='qcow2',id=51d4a3aa-5eba-4773-bb5c-72300483f2dd,min_disk=0,min_ram=0,name='tempest-scenario-img--1750488039',owner='137870b8216f4a49b1eecde3ec14b75a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:49:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '51d4a3aa-5eba-4773-bb5c-72300483f2dd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:49:20 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:20 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:49:14Z,direct_url=<?>,disk_format='qcow2',id=51d4a3aa-5eba-4773-bb5c-72300483f2dd,min_disk=0,min_ram=0,name='tempest-scenario-img--1750488039',owner='137870b8216f4a49b1eecde3ec14b75a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:49:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-25201554',display_name='tempest-TestMinimumBasicScenario-server-25201554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-25201554',id=26,image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeMrMy/sg8XxWtYVyzeFxR7apHfoUn94/bg1fXss/Ic+vdCwCyawATmHr7tQMWjdJcw/9i3eMIb4VHHfQtc1ntaLqNp4C9Dkh99q7CMBGUWZcrFycpxkFPQJHKvbN6R7w==',key_name='tempest-TestMinimumBasicScenario-454614026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-rnf101oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:49:18Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=5b6ea39f-b167-480f-a288-d9bcf55434d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:49:20 user nova-compute[74241]:   <uuid>5b6ea39f-b167-480f-a288-d9bcf55434d2</uuid>
Oct 20 11:49:20 user nova-compute[74241]:   <name>instance-0000001a</name>
Oct 20 11:49:20 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:49:20 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:49:20 user nova-compute[74241]:   <metadata>
Oct 20 11:49:20 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:49:20 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:49:20 user nova-compute[74241]:       <nova:name>tempest-TestMinimumBasicScenario-server-25201554</nova:name>
Oct 20 11:49:20 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:49:20</nova:creationTime>
Oct 20 11:49:20 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:49:20 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:49:20 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:49:20 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:49:20 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:49:20 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:49:20 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:49:20 user nova-compute[74241]:       <nova:owner>
Oct 20 11:49:20 user nova-compute[74241]:         <nova:user uuid="cd2b2cd84c5a403f868d69ccc7f8afc4">tempest-TestMinimumBasicScenario-2068641795-project-member</nova:user>
Oct 20 11:49:20 user nova-compute[74241]:         <nova:project uuid="137870b8216f4a49b1eecde3ec14b75a">tempest-TestMinimumBasicScenario-2068641795</nova:project>
Oct 20 11:49:20 user nova-compute[74241]:       </nova:owner>
Oct 20 11:49:20 user nova-compute[74241]:       <nova:root type="image" uuid="51d4a3aa-5eba-4773-bb5c-72300483f2dd"/>
Oct 20 11:49:20 user nova-compute[74241]:       <nova:ports>
Oct 20 11:49:20 user nova-compute[74241]:         <nova:port uuid="b6096fc9-6928-4d9e-9066-9174bd327ff2">
Oct 20 11:49:20 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 11:49:20 user nova-compute[74241]:         </nova:port>
Oct 20 11:49:20 user nova-compute[74241]:       </nova:ports>
Oct 20 11:49:20 user nova-compute[74241]:     </nova:instance>
Oct 20 11:49:20 user nova-compute[74241]:   </metadata>
Oct 20 11:49:20 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:49:20 user nova-compute[74241]:     <system>
Oct 20 11:49:20 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:49:20 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:49:20 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:49:20 user nova-compute[74241]:       <entry name="serial">5b6ea39f-b167-480f-a288-d9bcf55434d2</entry>
Oct 20 11:49:20 user nova-compute[74241]:       <entry name="uuid">5b6ea39f-b167-480f-a288-d9bcf55434d2</entry>
Oct 20 11:49:20 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:49:20 user nova-compute[74241]:     </system>
Oct 20 11:49:20 user nova-compute[74241]:   </sysinfo>
Oct 20 11:49:20 user nova-compute[74241]:   <os>
Oct 20 11:49:20 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:49:20 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:49:20 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:49:20 user nova-compute[74241]:   </os>
Oct 20 11:49:20 user nova-compute[74241]:   <features>
Oct 20 11:49:20 user nova-compute[74241]:     <acpi/>
Oct 20 11:49:20 user nova-compute[74241]:     <apic/>
Oct 20 11:49:20 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:49:20 user nova-compute[74241]:   </features>
Oct 20 11:49:20 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:49:20 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:49:20 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:49:20 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:49:20 user nova-compute[74241]:   </clock>
Oct 20 11:49:20 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:49:20 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:49:20 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:49:20 user nova-compute[74241]:   </cpu>
Oct 20 11:49:20 user nova-compute[74241]:   <devices>
Oct 20 11:49:20 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:49:20 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:49:20 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk"/>
Oct 20 11:49:20 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:49:20 user nova-compute[74241]:     </disk>
Oct 20 11:49:20 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:49:20 user nova-compute[74241]:       <mac address="fa:16:3e:54:e1:43"/>
Oct 20 11:49:20 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:20 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:49:20 user nova-compute[74241]:       <target dev="tapb6096fc9-69"/>
Oct 20 11:49:20 user nova-compute[74241]:     </interface>
Oct 20 11:49:20 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:49:20 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/console.log" append="off"/>
Oct 20 11:49:20 user nova-compute[74241]:     </serial>
Oct 20 11:49:20 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:49:20 user nova-compute[74241]:     <video>
Oct 20 11:49:20 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:20 user nova-compute[74241]:     </video>
Oct 20 11:49:20 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:49:20 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:49:20 user nova-compute[74241]:     </rng>
Oct 20 11:49:20 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:49:20 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:49:20 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:49:20 user nova-compute[74241]:     </memballoon>
Oct 20 11:49:20 user nova-compute[74241]:   </devices>
Oct 20 11:49:20 user nova-compute[74241]: </domain>
Oct 20 11:49:20 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-25201554',display_name='tempest-TestMinimumBasicScenario-server-25201554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-25201554',id=26,image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeMrMy/sg8XxWtYVyzeFxR7apHfoUn94/bg1fXss/Ic+vdCwCyawATmHr7tQMWjdJcw/9i3eMIb4VHHfQtc1ntaLqNp4C9Dkh99q7CMBGUWZcrFycpxkFPQJHKvbN6R7w==',key_name='tempest-TestMinimumBasicScenario-454614026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-rnf101oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:49:18Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=5b6ea39f-b167-480f-a288-d9bcf55434d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG os_vif [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8208a151-6342-5320-8502-873639436e3d', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6096fc9-69, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6096fc9-69, col_values=(('qos', UUID('46d24cfa-d9fa-48e2-a20c-ffdb90a2549a')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6096fc9-69, col_values=(('external_ids', {'iface-id': 'b6096fc9-6928-4d9e-9066-9174bd327ff2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:e1:43', 'vm-uuid': '5b6ea39f-b167-480f-a288-d9bcf55434d2'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:20 user nova-compute[74241]: INFO os_vif [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69')
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No VIF found with MAC fa:16:3e:54:e1:43, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-9bf09016-eadc-45c1-802a-18766a18f60b req-f99a99b9-cbd0-421b-aee2-d94ad6374fd1 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updated VIF entry in instance network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-9bf09016-eadc-45c1-802a-18766a18f60b req-f99a99b9-cbd0-421b-aee2-d94ad6374fd1 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating instance_info_cache with network_info: [{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9bf09016-eadc-45c1-802a-18766a18f60b req-f99a99b9-cbd0-421b-aee2-d94ad6374fd1 service nova] Releasing lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-bac3ad38-5f1e-4843-9ba8-09180d4435c4 req-e33e824e-fffa-488c-b1cf-59644dfdd147 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bac3ad38-5f1e-4843-9ba8-09180d4435c4 req-e33e824e-fffa-488c-b1cf-59644dfdd147 service nova] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bac3ad38-5f1e-4843-9ba8-09180d4435c4 req-e33e824e-fffa-488c-b1cf-59644dfdd147 service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bac3ad38-5f1e-4843-9ba8-09180d4435c4 req-e33e824e-fffa-488c-b1cf-59644dfdd147 service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-bac3ad38-5f1e-4843-9ba8-09180d4435c4 req-e33e824e-fffa-488c-b1cf-59644dfdd147 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] No waiting events found dispatching network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:22 user nova-compute[74241]: WARNING nova.compute.manager [req-bac3ad38-5f1e-4843-9ba8-09180d4435c4 req-e33e824e-fffa-488c-b1cf-59644dfdd147 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received unexpected event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 for instance with vm_state building and task_state spawning.
Oct 20 11:49:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:49:24 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Instance spawned successfully.
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-192c3992-faa4-4e0b-9371-3c0c578949f8 req-1c698e92-2e3a-4ee7-86ec-975fd667977b service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-192c3992-faa4-4e0b-9371-3c0c578949f8 req-1c698e92-2e3a-4ee7-86ec-975fd667977b service nova] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-192c3992-faa4-4e0b-9371-3c0c578949f8 req-1c698e92-2e3a-4ee7-86ec-975fd667977b service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-192c3992-faa4-4e0b-9371-3c0c578949f8 req-1c698e92-2e3a-4ee7-86ec-975fd667977b service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-192c3992-faa4-4e0b-9371-3c0c578949f8 req-1c698e92-2e3a-4ee7-86ec-975fd667977b service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] No waiting events found dispatching network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:24 user nova-compute[74241]: WARNING nova.compute.manager [req-192c3992-faa4-4e0b-9371-3c0c578949f8 req-1c698e92-2e3a-4ee7-86ec-975fd667977b service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received unexpected event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 for instance with vm_state building and task_state spawning.
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:24 user nova-compute[74241]: INFO nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Took 6.29 seconds to spawn the instance on the hypervisor.
Oct 20 11:49:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:49:24 user nova-compute[74241]: INFO nova.compute.manager [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Took 6.95 seconds to build instance.
Oct 20 11:49:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f911197a-132d-4b26-ac5d-cc1b0a0896ef tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.054s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:49:33 user nova-compute[74241]: INFO nova.compute.claims [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Claim successful on node user
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:49:33 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.policy [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3637bc89e77c475ba2fc72002d61b5c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ce95d8752f04f25a15f0673b063d405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:49:33 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Creating image(s)
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "/opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "/opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "/opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk 1073741824" returned: 0 in 0.154s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.365s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.208s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG nova.network.neutron [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Successfully created port: 135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Cannot resize image /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Ensure instance console log exists: /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Successfully updated port: 135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquired lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.compute.manager [req-ace8ac97-76b5-401f-983e-abcff31fba73 req-85e51227-e2b7-4fe1-ba13-53fd2d816349 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received event network-changed-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.compute.manager [req-ace8ac97-76b5-401f-983e-abcff31fba73 req-85e51227-e2b7-4fe1-ba13-53fd2d816349 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Refreshing instance network info cache due to event network-changed-135ab84c-fb70-47b9-a4ff-1d29c9f61018. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ace8ac97-76b5-401f-983e-abcff31fba73 req-85e51227-e2b7-4fe1-ba13-53fd2d816349 service nova] Acquiring lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Updating instance_info_cache with network_info: [{"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Releasing lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Instance network_info: |[{"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ace8ac97-76b5-401f-983e-abcff31fba73 req-85e51227-e2b7-4fe1-ba13-53fd2d816349 service nova] Acquired lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.neutron [req-ace8ac97-76b5-401f-983e-abcff31fba73 req-85e51227-e2b7-4fe1-ba13-53fd2d816349 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Refreshing network info cache for port 135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Start _get_guest_xml network_info=[{"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:49:35 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:35 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1255891937',display_name='tempest-AttachVolumeNegativeTest-server-1255891937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1255891937',id=27,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQJequjGBUORVeDPJjWyOHId0pzB6eqO993QVx759T50cBeqPFybjk5P2Jrm3hwQtdAecgWNk2g0uzMLe87NmWKtKMoPRghJ0LGz6Yai2zaBXwKWxeWZFFsDDyTMafsOw==',key_name='tempest-keypair-34916076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-6kv6zr3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=743736c6-e1de-4f11-bc3c-09194744e60e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=135ab84c-fb70-47b9-a4ff-1d29c9f61018,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ab84c-fb') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'pci_devices' on Instance uuid 743736c6-e1de-4f11-bc3c-09194744e60e {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:49:35 user nova-compute[74241]:   <uuid>743736c6-e1de-4f11-bc3c-09194744e60e</uuid>
Oct 20 11:49:35 user nova-compute[74241]:   <name>instance-0000001b</name>
Oct 20 11:49:35 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:49:35 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:49:35 user nova-compute[74241]:   <metadata>
Oct 20 11:49:35 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:49:35 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:49:35 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1255891937</nova:name>
Oct 20 11:49:35 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:49:35</nova:creationTime>
Oct 20 11:49:35 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:49:35 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:49:35 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:49:35 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:49:35 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:49:35 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:49:35 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:49:35 user nova-compute[74241]:       <nova:owner>
Oct 20 11:49:35 user nova-compute[74241]:         <nova:user uuid="3637bc89e77c475ba2fc72002d61b5c2">tempest-AttachVolumeNegativeTest-252317716-project-member</nova:user>
Oct 20 11:49:35 user nova-compute[74241]:         <nova:project uuid="4ce95d8752f04f25a15f0673b063d405">tempest-AttachVolumeNegativeTest-252317716</nova:project>
Oct 20 11:49:35 user nova-compute[74241]:       </nova:owner>
Oct 20 11:49:35 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:49:35 user nova-compute[74241]:       <nova:ports>
Oct 20 11:49:35 user nova-compute[74241]:         <nova:port uuid="135ab84c-fb70-47b9-a4ff-1d29c9f61018">
Oct 20 11:49:35 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 11:49:35 user nova-compute[74241]:         </nova:port>
Oct 20 11:49:35 user nova-compute[74241]:       </nova:ports>
Oct 20 11:49:35 user nova-compute[74241]:     </nova:instance>
Oct 20 11:49:35 user nova-compute[74241]:   </metadata>
Oct 20 11:49:35 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:49:35 user nova-compute[74241]:     <system>
Oct 20 11:49:35 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:49:35 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:49:35 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:49:35 user nova-compute[74241]:       <entry name="serial">743736c6-e1de-4f11-bc3c-09194744e60e</entry>
Oct 20 11:49:35 user nova-compute[74241]:       <entry name="uuid">743736c6-e1de-4f11-bc3c-09194744e60e</entry>
Oct 20 11:49:35 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:49:35 user nova-compute[74241]:     </system>
Oct 20 11:49:35 user nova-compute[74241]:   </sysinfo>
Oct 20 11:49:35 user nova-compute[74241]:   <os>
Oct 20 11:49:35 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:49:35 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:49:35 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:49:35 user nova-compute[74241]:   </os>
Oct 20 11:49:35 user nova-compute[74241]:   <features>
Oct 20 11:49:35 user nova-compute[74241]:     <acpi/>
Oct 20 11:49:35 user nova-compute[74241]:     <apic/>
Oct 20 11:49:35 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:49:35 user nova-compute[74241]:   </features>
Oct 20 11:49:35 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:49:35 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:49:35 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:49:35 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:49:35 user nova-compute[74241]:   </clock>
Oct 20 11:49:35 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:49:35 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:49:35 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:49:35 user nova-compute[74241]:   </cpu>
Oct 20 11:49:35 user nova-compute[74241]:   <devices>
Oct 20 11:49:35 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:49:35 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:49:35 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk"/>
Oct 20 11:49:35 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:49:35 user nova-compute[74241]:     </disk>
Oct 20 11:49:35 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:49:35 user nova-compute[74241]:       <mac address="fa:16:3e:3d:fe:a2"/>
Oct 20 11:49:35 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:35 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:49:35 user nova-compute[74241]:       <target dev="tap135ab84c-fb"/>
Oct 20 11:49:35 user nova-compute[74241]:     </interface>
Oct 20 11:49:35 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:49:35 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/console.log" append="off"/>
Oct 20 11:49:35 user nova-compute[74241]:     </serial>
Oct 20 11:49:35 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:49:35 user nova-compute[74241]:     <video>
Oct 20 11:49:35 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:35 user nova-compute[74241]:     </video>
Oct 20 11:49:35 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:49:35 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:49:35 user nova-compute[74241]:     </rng>
Oct 20 11:49:35 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:49:35 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:49:35 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:49:35 user nova-compute[74241]:     </memballoon>
Oct 20 11:49:35 user nova-compute[74241]:   </devices>
Oct 20 11:49:35 user nova-compute[74241]: </domain>
Oct 20 11:49:35 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1255891937',display_name='tempest-AttachVolumeNegativeTest-server-1255891937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1255891937',id=27,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQJequjGBUORVeDPJjWyOHId0pzB6eqO993QVx759T50cBeqPFybjk5P2Jrm3hwQtdAecgWNk2g0uzMLe87NmWKtKMoPRghJ0LGz6Yai2zaBXwKWxeWZFFsDDyTMafsOw==',key_name='tempest-keypair-34916076',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-6kv6zr3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:49:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=743736c6-e1de-4f11-bc3c-09194744e60e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=135ab84c-fb70-47b9-a4ff-1d29c9f61018,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ab84c-fb') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG os_vif [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=135ab84c-fb70-47b9-a4ff-1d29c9f61018,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ab84c-fb') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '298fbdfb-0bb7-581d-afc5-2e1731e59243', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap135ab84c-fb, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap135ab84c-fb, col_values=(('qos', UUID('631fec5c-4b50-4c37-a6d8-dcbfba38082f')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap135ab84c-fb, col_values=(('external_ids', {'iface-id': '135ab84c-fb70-47b9-a4ff-1d29c9f61018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:fe:a2', 'vm-uuid': '743736c6-e1de-4f11-bc3c-09194744e60e'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:35 user nova-compute[74241]: INFO os_vif [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=135ab84c-fb70-47b9-a4ff-1d29c9f61018,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ab84c-fb')
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:49:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No VIF found with MAC fa:16:3e:3d:fe:a2, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:49:36 user nova-compute[74241]: DEBUG nova.network.neutron [req-ace8ac97-76b5-401f-983e-abcff31fba73 req-85e51227-e2b7-4fe1-ba13-53fd2d816349 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Updated VIF entry in instance network info cache for port 135ab84c-fb70-47b9-a4ff-1d29c9f61018. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:49:36 user nova-compute[74241]: DEBUG nova.network.neutron [req-ace8ac97-76b5-401f-983e-abcff31fba73 req-85e51227-e2b7-4fe1-ba13-53fd2d816349 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Updating instance_info_cache with network_info: [{"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ace8ac97-76b5-401f-983e-abcff31fba73 req-85e51227-e2b7-4fe1-ba13-53fd2d816349 service nova] Releasing lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG nova.compute.manager [req-58ee628d-ada0-40f3-a93b-7ca148dc3101 req-30921c18-1e04-4195-8283-e1a53f3f5d7c service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received event network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-58ee628d-ada0-40f3-a93b-7ca148dc3101 req-30921c18-1e04-4195-8283-e1a53f3f5d7c service nova] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-58ee628d-ada0-40f3-a93b-7ca148dc3101 req-30921c18-1e04-4195-8283-e1a53f3f5d7c service nova] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-58ee628d-ada0-40f3-a93b-7ca148dc3101 req-30921c18-1e04-4195-8283-e1a53f3f5d7c service nova] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG nova.compute.manager [req-58ee628d-ada0-40f3-a93b-7ca148dc3101 req-30921c18-1e04-4195-8283-e1a53f3f5d7c service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] No waiting events found dispatching network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:37 user nova-compute[74241]: WARNING nova.compute.manager [req-58ee628d-ada0-40f3-a93b-7ca148dc3101 req-30921c18-1e04-4195-8283-e1a53f3f5d7c service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received unexpected event network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 for instance with vm_state building and task_state spawning.
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid f289e23f-cab7-4631-9c80-6b0391bbea89 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid ec07982b-d7ea-4950-aca1-c6120927cfb0 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 743736c6-e1de-4f11-bc3c-09194744e60e {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "031a2001-57b8-4411-bed1-69eac953d40b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "031a2001-57b8-4411-bed1-69eac953d40b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:49:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Instance spawned successfully.
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:39 user nova-compute[74241]: INFO nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Took 5.98 seconds to spawn the instance on the hypervisor.
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:49:39 user nova-compute[74241]: INFO nova.compute.manager [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Took 6.75 seconds to build instance.
Oct 20 11:49:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c82cfce2-8a13-455c-ac9a-3193b4e347a9 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.848s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.011s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:39 user nova-compute[74241]: INFO nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 20 11:49:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-cc182ba3-294b-48f3-8639-0372ce507d2f req-91e953ba-a311-46e2-b8bd-e0a024102066 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received event network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cc182ba3-294b-48f3-8639-0372ce507d2f req-91e953ba-a311-46e2-b8bd-e0a024102066 service nova] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cc182ba3-294b-48f3-8639-0372ce507d2f req-91e953ba-a311-46e2-b8bd-e0a024102066 service nova] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cc182ba3-294b-48f3-8639-0372ce507d2f req-91e953ba-a311-46e2-b8bd-e0a024102066 service nova] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-cc182ba3-294b-48f3-8639-0372ce507d2f req-91e953ba-a311-46e2-b8bd-e0a024102066 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] No waiting events found dispatching network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:39 user nova-compute[74241]: WARNING nova.compute.manager [req-cc182ba3-294b-48f3-8639-0372ce507d2f req-91e953ba-a311-46e2-b8bd-e0a024102066 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received unexpected event network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 for instance with vm_state active and task_state None.
Oct 20 11:49:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "48613baf-40b5-4648-a8af-6d96ab7a245b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:49:42 user nova-compute[74241]: INFO nova.compute.claims [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Claim successful on node user
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.338s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:49:42 user nova-compute[74241]: INFO nova.compute.claims [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Claim successful on node user
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:49:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.policy [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c611c28a9264820a26f203045040420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f8151a0cf44b2d89838da474c2dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:49:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Creating image(s)
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "/opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "/opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "/opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:49:43 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.246s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Successfully created port: 06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.policy [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f1fe587313141b488e5975c3e72c571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4764e42940fd415986f661c0abfe5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk 1073741824" returned: 0 in 0.070s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:49:43 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Creating image(s)
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "/opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "/opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.244s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.215s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Cannot resize image /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Ensure instance console log exists: /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk 1073741824" returned: 0 in 0.068s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Successfully updated port: 06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquired lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c495ee6-bfca-487c-be5b-37acaa401f0a req-6060c44d-110f-4190-a5e4-094f030a255c service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received event network-changed-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-2c495ee6-bfca-487c-be5b-37acaa401f0a req-6060c44d-110f-4190-a5e4-094f030a255c service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Refreshing instance network info cache due to event network-changed-06b4f3fe-703a-46a2-97e9-b645662f3a0f. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c495ee6-bfca-487c-be5b-37acaa401f0a req-6060c44d-110f-4190-a5e4-094f030a255c service nova] Acquiring lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Successfully created port: 3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Cannot resize image /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Ensure instance console log exists: /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updating instance_info_cache with network_info: [{"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Releasing lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Instance network_info: |[{"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c495ee6-bfca-487c-be5b-37acaa401f0a req-6060c44d-110f-4190-a5e4-094f030a255c service nova] Acquired lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-2c495ee6-bfca-487c-be5b-37acaa401f0a req-6060c44d-110f-4190-a5e4-094f030a255c service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Refreshing network info cache for port 06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Start _get_guest_xml network_info=[{"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:49:44 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:44 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1395882665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1395882665',id=28,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-1na0vs1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:49:43Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=48613baf-40b5-4648-a8af-6d96ab7a245b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:95:ca,bridge_name='br-int',has_traffic_filtering=True,id=06b4f3fe-703a-46a2-97e9-b645662f3a0f,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b4f3fe-70') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'pci_devices' on Instance uuid 48613baf-40b5-4648-a8af-6d96ab7a245b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:49:44 user nova-compute[74241]:   <uuid>48613baf-40b5-4648-a8af-6d96ab7a245b</uuid>
Oct 20 11:49:44 user nova-compute[74241]:   <name>instance-0000001c</name>
Oct 20 11:49:44 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:49:44 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:49:44 user nova-compute[74241]:   <metadata>
Oct 20 11:49:44 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:49:44 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:49:44 user nova-compute[74241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1395882665</nova:name>
Oct 20 11:49:44 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:49:44</nova:creationTime>
Oct 20 11:49:44 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:49:44 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:49:44 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:49:44 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:49:44 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:49:44 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:49:44 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:49:44 user nova-compute[74241]:       <nova:owner>
Oct 20 11:49:44 user nova-compute[74241]:         <nova:user uuid="0c611c28a9264820a26f203045040420">tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member</nova:user>
Oct 20 11:49:44 user nova-compute[74241]:         <nova:project uuid="52f8151a0cf44b2d89838da474c2dc68">tempest-ServerBootFromVolumeStableRescueTest-929360393</nova:project>
Oct 20 11:49:44 user nova-compute[74241]:       </nova:owner>
Oct 20 11:49:44 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:49:44 user nova-compute[74241]:       <nova:ports>
Oct 20 11:49:44 user nova-compute[74241]:         <nova:port uuid="06b4f3fe-703a-46a2-97e9-b645662f3a0f">
Oct 20 11:49:44 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 11:49:44 user nova-compute[74241]:         </nova:port>
Oct 20 11:49:44 user nova-compute[74241]:       </nova:ports>
Oct 20 11:49:44 user nova-compute[74241]:     </nova:instance>
Oct 20 11:49:44 user nova-compute[74241]:   </metadata>
Oct 20 11:49:44 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:49:44 user nova-compute[74241]:     <system>
Oct 20 11:49:44 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:49:44 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:49:44 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:49:44 user nova-compute[74241]:       <entry name="serial">48613baf-40b5-4648-a8af-6d96ab7a245b</entry>
Oct 20 11:49:44 user nova-compute[74241]:       <entry name="uuid">48613baf-40b5-4648-a8af-6d96ab7a245b</entry>
Oct 20 11:49:44 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:49:44 user nova-compute[74241]:     </system>
Oct 20 11:49:44 user nova-compute[74241]:   </sysinfo>
Oct 20 11:49:44 user nova-compute[74241]:   <os>
Oct 20 11:49:44 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:49:44 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:49:44 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:49:44 user nova-compute[74241]:   </os>
Oct 20 11:49:44 user nova-compute[74241]:   <features>
Oct 20 11:49:44 user nova-compute[74241]:     <acpi/>
Oct 20 11:49:44 user nova-compute[74241]:     <apic/>
Oct 20 11:49:44 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:49:44 user nova-compute[74241]:   </features>
Oct 20 11:49:44 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:49:44 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:49:44 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:49:44 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:49:44 user nova-compute[74241]:   </clock>
Oct 20 11:49:44 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:49:44 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:49:44 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:49:44 user nova-compute[74241]:   </cpu>
Oct 20 11:49:44 user nova-compute[74241]:   <devices>
Oct 20 11:49:44 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:49:44 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:49:44 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk"/>
Oct 20 11:49:44 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:49:44 user nova-compute[74241]:     </disk>
Oct 20 11:49:44 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:49:44 user nova-compute[74241]:       <mac address="fa:16:3e:34:95:ca"/>
Oct 20 11:49:44 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:44 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:49:44 user nova-compute[74241]:       <target dev="tap06b4f3fe-70"/>
Oct 20 11:49:44 user nova-compute[74241]:     </interface>
Oct 20 11:49:44 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:49:44 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/console.log" append="off"/>
Oct 20 11:49:44 user nova-compute[74241]:     </serial>
Oct 20 11:49:44 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:49:44 user nova-compute[74241]:     <video>
Oct 20 11:49:44 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:44 user nova-compute[74241]:     </video>
Oct 20 11:49:44 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:49:44 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:49:44 user nova-compute[74241]:     </rng>
Oct 20 11:49:44 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:49:44 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:49:44 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:49:44 user nova-compute[74241]:     </memballoon>
Oct 20 11:49:44 user nova-compute[74241]:   </devices>
Oct 20 11:49:44 user nova-compute[74241]: </domain>
Oct 20 11:49:44 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1395882665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1395882665',id=28,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-1na0vs1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:49:43Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=48613baf-40b5-4648-a8af-6d96ab7a245b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:95:ca,bridge_name='br-int',has_traffic_filtering=True,id=06b4f3fe-703a-46a2-97e9-b645662f3a0f,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b4f3fe-70') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG os_vif [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:95:ca,bridge_name='br-int',has_traffic_filtering=True,id=06b4f3fe-703a-46a2-97e9-b645662f3a0f,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b4f3fe-70') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64fa0337-f28a-5516-ac26-5ba66a3d7935', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap06b4f3fe-70, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap06b4f3fe-70, col_values=(('qos', UUID('7eec182f-96db-47f4-a665-e14dcf1156fb')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap06b4f3fe-70, col_values=(('external_ids', {'iface-id': '06b4f3fe-703a-46a2-97e9-b645662f3a0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:95:ca', 'vm-uuid': '48613baf-40b5-4648-a8af-6d96ab7a245b'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:44 user nova-compute[74241]: INFO os_vif [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:95:ca,bridge_name='br-int',has_traffic_filtering=True,id=06b4f3fe-703a-46a2-97e9-b645662f3a0f,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b4f3fe-70')
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No VIF found with MAC fa:16:3e:34:95:ca, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Successfully updated port: 3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquired lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-d38ff105-07c9-4231-9bbf-aec7260298ca req-3c297fde-c0a0-402d-b33d-db24816cae67 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received event network-changed-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-d38ff105-07c9-4231-9bbf-aec7260298ca req-3c297fde-c0a0-402d-b33d-db24816cae67 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Refreshing instance network info cache due to event network-changed-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d38ff105-07c9-4231-9bbf-aec7260298ca req-3c297fde-c0a0-402d-b33d-db24816cae67 service nova] Acquiring lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:49:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.neutron [req-2c495ee6-bfca-487c-be5b-37acaa401f0a req-6060c44d-110f-4190-a5e4-094f030a255c service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updated VIF entry in instance network info cache for port 06b4f3fe-703a-46a2-97e9-b645662f3a0f. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.neutron [req-2c495ee6-bfca-487c-be5b-37acaa401f0a req-6060c44d-110f-4190-a5e4-094f030a255c service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updating instance_info_cache with network_info: [{"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2c495ee6-bfca-487c-be5b-37acaa401f0a req-6060c44d-110f-4190-a5e4-094f030a255c service nova] Releasing lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.neutron [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Updating instance_info_cache with network_info: [{"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Releasing lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Instance network_info: |[{"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d38ff105-07c9-4231-9bbf-aec7260298ca req-3c297fde-c0a0-402d-b33d-db24816cae67 service nova] Acquired lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.neutron [req-d38ff105-07c9-4231-9bbf-aec7260298ca req-3c297fde-c0a0-402d-b33d-db24816cae67 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Refreshing network info cache for port 3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Start _get_guest_xml network_info=[{"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:49:45 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:45 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1028793549',display_name='tempest-VolumesSnapshotTestJSON-instance-1028793549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1028793549',id=29,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYv5uHlwb3rIpGuwMRLMXi+ZmFw/QAQDJFm0tOELWr569P/x4ZTs7G5A49B56wzvaqQYh+Zne03KsAQ9sjLXXlkhwytSjY8GmZI2kpMRqHosjxfeTiMYEB54mbs3OHFCA==',key_name='tempest-keypair-618012453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4764e42940fd415986f661c0abfe5e5b',ramdisk_id='',reservation_id='r-m6650tol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-740119974',owner_user_name='tempest-VolumesSnapshotTestJSON-740119974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f1fe587313141b488e5975c3e72c571',uuid=e0723ef5-96db-4191-84da-05eab21e5837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converting VIF {"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f2db4-3d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.objects.instance [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'pci_devices' on Instance uuid e0723ef5-96db-4191-84da-05eab21e5837 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:49:45 user nova-compute[74241]:   <uuid>e0723ef5-96db-4191-84da-05eab21e5837</uuid>
Oct 20 11:49:45 user nova-compute[74241]:   <name>instance-0000001d</name>
Oct 20 11:49:45 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:49:45 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:49:45 user nova-compute[74241]:   <metadata>
Oct 20 11:49:45 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:49:45 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:49:45 user nova-compute[74241]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1028793549</nova:name>
Oct 20 11:49:45 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:49:45</nova:creationTime>
Oct 20 11:49:45 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:49:45 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:49:45 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:49:45 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:49:45 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:49:45 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:49:45 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:49:45 user nova-compute[74241]:       <nova:owner>
Oct 20 11:49:45 user nova-compute[74241]:         <nova:user uuid="4f1fe587313141b488e5975c3e72c571">tempest-VolumesSnapshotTestJSON-740119974-project-member</nova:user>
Oct 20 11:49:45 user nova-compute[74241]:         <nova:project uuid="4764e42940fd415986f661c0abfe5e5b">tempest-VolumesSnapshotTestJSON-740119974</nova:project>
Oct 20 11:49:45 user nova-compute[74241]:       </nova:owner>
Oct 20 11:49:45 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:49:45 user nova-compute[74241]:       <nova:ports>
Oct 20 11:49:45 user nova-compute[74241]:         <nova:port uuid="3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2">
Oct 20 11:49:45 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 11:49:45 user nova-compute[74241]:         </nova:port>
Oct 20 11:49:45 user nova-compute[74241]:       </nova:ports>
Oct 20 11:49:45 user nova-compute[74241]:     </nova:instance>
Oct 20 11:49:45 user nova-compute[74241]:   </metadata>
Oct 20 11:49:45 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:49:45 user nova-compute[74241]:     <system>
Oct 20 11:49:45 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:49:45 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:49:45 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:49:45 user nova-compute[74241]:       <entry name="serial">e0723ef5-96db-4191-84da-05eab21e5837</entry>
Oct 20 11:49:45 user nova-compute[74241]:       <entry name="uuid">e0723ef5-96db-4191-84da-05eab21e5837</entry>
Oct 20 11:49:45 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:49:45 user nova-compute[74241]:     </system>
Oct 20 11:49:45 user nova-compute[74241]:   </sysinfo>
Oct 20 11:49:45 user nova-compute[74241]:   <os>
Oct 20 11:49:45 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:49:45 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:49:45 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:49:45 user nova-compute[74241]:   </os>
Oct 20 11:49:45 user nova-compute[74241]:   <features>
Oct 20 11:49:45 user nova-compute[74241]:     <acpi/>
Oct 20 11:49:45 user nova-compute[74241]:     <apic/>
Oct 20 11:49:45 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:49:45 user nova-compute[74241]:   </features>
Oct 20 11:49:45 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:49:45 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:49:45 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:49:45 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:49:45 user nova-compute[74241]:   </clock>
Oct 20 11:49:45 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:49:45 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:49:45 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:49:45 user nova-compute[74241]:   </cpu>
Oct 20 11:49:45 user nova-compute[74241]:   <devices>
Oct 20 11:49:45 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:49:45 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:49:45 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk"/>
Oct 20 11:49:45 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:49:45 user nova-compute[74241]:     </disk>
Oct 20 11:49:45 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:49:45 user nova-compute[74241]:       <mac address="fa:16:3e:fc:76:9b"/>
Oct 20 11:49:45 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:45 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:49:45 user nova-compute[74241]:       <target dev="tap3e8f2db4-3d"/>
Oct 20 11:49:45 user nova-compute[74241]:     </interface>
Oct 20 11:49:45 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:49:45 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/console.log" append="off"/>
Oct 20 11:49:45 user nova-compute[74241]:     </serial>
Oct 20 11:49:45 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:49:45 user nova-compute[74241]:     <video>
Oct 20 11:49:45 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:49:45 user nova-compute[74241]:     </video>
Oct 20 11:49:45 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:49:45 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:49:45 user nova-compute[74241]:     </rng>
Oct 20 11:49:45 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:49:45 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:49:45 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:49:45 user nova-compute[74241]:     </memballoon>
Oct 20 11:49:45 user nova-compute[74241]:   </devices>
Oct 20 11:49:45 user nova-compute[74241]: </domain>
Oct 20 11:49:45 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1028793549',display_name='tempest-VolumesSnapshotTestJSON-instance-1028793549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1028793549',id=29,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYv5uHlwb3rIpGuwMRLMXi+ZmFw/QAQDJFm0tOELWr569P/x4ZTs7G5A49B56wzvaqQYh+Zne03KsAQ9sjLXXlkhwytSjY8GmZI2kpMRqHosjxfeTiMYEB54mbs3OHFCA==',key_name='tempest-keypair-618012453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4764e42940fd415986f661c0abfe5e5b',ramdisk_id='',reservation_id='r-m6650tol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-740119974',owner_user_name='tempest-VolumesSnapshotTestJSON-740119974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:49:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f1fe587313141b488e5975c3e72c571',uuid=e0723ef5-96db-4191-84da-05eab21e5837,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converting VIF {"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f2db4-3d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG os_vif [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f2db4-3d') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '400dd078-d606-5acc-bfb1-63baff519b31', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e8f2db4-3d, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e8f2db4-3d, col_values=(('qos', UUID('7e2e56f5-449a-4c84-927b-14f104386e6f')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e8f2db4-3d, col_values=(('external_ids', {'iface-id': '3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:76:9b', 'vm-uuid': 'e0723ef5-96db-4191-84da-05eab21e5837'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:45 user nova-compute[74241]: INFO os_vif [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f2db4-3d')
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No VIF found with MAC fa:16:3e:fc:76:9b, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.neutron [req-d38ff105-07c9-4231-9bbf-aec7260298ca req-3c297fde-c0a0-402d-b33d-db24816cae67 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Updated VIF entry in instance network info cache for port 3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG nova.network.neutron [req-d38ff105-07c9-4231-9bbf-aec7260298ca req-3c297fde-c0a0-402d-b33d-db24816cae67 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Updating instance_info_cache with network_info: [{"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:49:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d38ff105-07c9-4231-9bbf-aec7260298ca req-3c297fde-c0a0-402d-b33d-db24816cae67 service nova] Releasing lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-ef8dcf88-bd15-44a1-891e-51492320fc21 req-c6d1a0cd-3ba9-4cc0-b44d-36a76fed76aa service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received event network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ef8dcf88-bd15-44a1-891e-51492320fc21 req-c6d1a0cd-3ba9-4cc0-b44d-36a76fed76aa service nova] Acquiring lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ef8dcf88-bd15-44a1-891e-51492320fc21 req-c6d1a0cd-3ba9-4cc0-b44d-36a76fed76aa service nova] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ef8dcf88-bd15-44a1-891e-51492320fc21 req-c6d1a0cd-3ba9-4cc0-b44d-36a76fed76aa service nova] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-ef8dcf88-bd15-44a1-891e-51492320fc21 req-c6d1a0cd-3ba9-4cc0-b44d-36a76fed76aa service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] No waiting events found dispatching network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:47 user nova-compute[74241]: WARNING nova.compute.manager [req-ef8dcf88-bd15-44a1-891e-51492320fc21 req-c6d1a0cd-3ba9-4cc0-b44d-36a76fed76aa service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received unexpected event network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f for instance with vm_state building and task_state spawning.
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-45bcdde4-e55c-4d8b-a555-f39e175a7f31 req-48b8c7c5-12e0-4353-9596-dfa8bffb8ac4 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received event network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-45bcdde4-e55c-4d8b-a555-f39e175a7f31 req-48b8c7c5-12e0-4353-9596-dfa8bffb8ac4 service nova] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-45bcdde4-e55c-4d8b-a555-f39e175a7f31 req-48b8c7c5-12e0-4353-9596-dfa8bffb8ac4 service nova] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-45bcdde4-e55c-4d8b-a555-f39e175a7f31 req-48b8c7c5-12e0-4353-9596-dfa8bffb8ac4 service nova] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-45bcdde4-e55c-4d8b-a555-f39e175a7f31 req-48b8c7c5-12e0-4353-9596-dfa8bffb8ac4 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] No waiting events found dispatching network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:47 user nova-compute[74241]: WARNING nova.compute.manager [req-45bcdde4-e55c-4d8b-a555-f39e175a7f31 req-48b8c7c5-12e0-4353-9596-dfa8bffb8ac4 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received unexpected event network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 for instance with vm_state building and task_state spawning.
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-93123e2c-0981-4a39-af88-949533bd6780 req-a079dc8c-4ab9-4065-8ee6-7b51d08d0c00 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received event network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93123e2c-0981-4a39-af88-949533bd6780 req-a079dc8c-4ab9-4065-8ee6-7b51d08d0c00 service nova] Acquiring lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93123e2c-0981-4a39-af88-949533bd6780 req-a079dc8c-4ab9-4065-8ee6-7b51d08d0c00 service nova] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93123e2c-0981-4a39-af88-949533bd6780 req-a079dc8c-4ab9-4065-8ee6-7b51d08d0c00 service nova] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-93123e2c-0981-4a39-af88-949533bd6780 req-a079dc8c-4ab9-4065-8ee6-7b51d08d0c00 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] No waiting events found dispatching network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:49 user nova-compute[74241]: WARNING nova.compute.manager [req-93123e2c-0981-4a39-af88-949533bd6780 req-a079dc8c-4ab9-4065-8ee6-7b51d08d0c00 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received unexpected event network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f for instance with vm_state building and task_state spawning.
Oct 20 11:49:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-064cbd65-a8b1-45ff-b4e9-b023c4c77f7d req-b884a542-63d9-4fa5-9a17-ee0062ad1aed service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received event network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-064cbd65-a8b1-45ff-b4e9-b023c4c77f7d req-b884a542-63d9-4fa5-9a17-ee0062ad1aed service nova] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-064cbd65-a8b1-45ff-b4e9-b023c4c77f7d req-b884a542-63d9-4fa5-9a17-ee0062ad1aed service nova] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-064cbd65-a8b1-45ff-b4e9-b023c4c77f7d req-b884a542-63d9-4fa5-9a17-ee0062ad1aed service nova] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-064cbd65-a8b1-45ff-b4e9-b023c4c77f7d req-b884a542-63d9-4fa5-9a17-ee0062ad1aed service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] No waiting events found dispatching network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:49:49 user nova-compute[74241]: WARNING nova.compute.manager [req-064cbd65-a8b1-45ff-b4e9-b023c4c77f7d req-b884a542-63d9-4fa5-9a17-ee0062ad1aed service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received unexpected event network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 for instance with vm_state building and task_state spawning.
Oct 20 11:49:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:49:49 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Instance spawned successfully.
Oct 20 11:49:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:49:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:49:50 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Instance spawned successfully.
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:49:50 user nova-compute[74241]: INFO nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Took 6.67 seconds to spawn the instance on the hypervisor.
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:49:50 user nova-compute[74241]: INFO nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Took 7.31 seconds to spawn the instance on the hypervisor.
Oct 20 11:49:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:49:50 user nova-compute[74241]: INFO nova.compute.manager [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Took 8.07 seconds to build instance.
Oct 20 11:49:50 user nova-compute[74241]: INFO nova.compute.manager [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Took 8.00 seconds to build instance.
Oct 20 11:49:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4052f8a-aff6-4e8b-bd99-68fd2549ab75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.175s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-629d9994-dde4-4d69-a065-72974b72b1bd tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.101s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:56 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:49:57 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:57 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:49:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:49:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:49:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.008s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:49:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:49:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:49:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:50:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:03 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:50:03 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:50:03 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7775MB free_disk=25.404830932617188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:50:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Applying migration context for instance ec07982b-d7ea-4950-aca1-c6120927cfb0 as it has an incoming, in-progress migration 686ac838-dea4-4426-b7f5-e0116a32ff2c. Migration status is finished {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 11:50:04 user nova-compute[74241]: INFO nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating resource usage from migration 686ac838-dea4-4426-b7f5-e0116a32ff2c
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Migration 686ac838-dea4-4426-b7f5-e0116a32ff2c is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 743736c6-e1de-4f11-bc3c-09194744e60e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e0723ef5-96db-4191-84da-05eab21e5837 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:50:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:50:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 11:50:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "8e272771-2827-400d-a7f9-d785c158dcf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "8e272771-2827-400d-a7f9-d785c158dcf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:50:14 user nova-compute[74241]: INFO nova.compute.claims [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Claim successful on node user
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.network.neutron [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:50:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:50:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Creating image(s)
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "/opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "/opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG nova.policy [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4914c45f8d42769609be5b8efac117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191f0dcc776c4b39854429de2da2f6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk 1073741824" returned: 0 in 0.052s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG nova.network.neutron [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Successfully created port: c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Cannot resize image /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Ensure instance console log exists: /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Successfully updated port: c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "refresh_cache-8e272771-2827-400d-a7f9-d785c158dcf3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquired lock "refresh_cache-8e272771-2827-400d-a7f9-d785c158dcf3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-d582bc64-46c9-44e1-9c76-d31f486119da req-16cb9a81-4fde-4238-865c-a8eeb5bb323f service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received event network-changed-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-d582bc64-46c9-44e1-9c76-d31f486119da req-16cb9a81-4fde-4238-865c-a8eeb5bb323f service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Refreshing instance network info cache due to event network-changed-c6f1a42c-92a2-49f0-a3f6-77904c10bec4. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d582bc64-46c9-44e1-9c76-d31f486119da req-16cb9a81-4fde-4238-865c-a8eeb5bb323f service nova] Acquiring lock "refresh_cache-8e272771-2827-400d-a7f9-d785c158dcf3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Updating instance_info_cache with network_info: [{"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Releasing lock "refresh_cache-8e272771-2827-400d-a7f9-d785c158dcf3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Instance network_info: |[{"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d582bc64-46c9-44e1-9c76-d31f486119da req-16cb9a81-4fde-4238-865c-a8eeb5bb323f service nova] Acquired lock "refresh_cache-8e272771-2827-400d-a7f9-d785c158dcf3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-d582bc64-46c9-44e1-9c76-d31f486119da req-16cb9a81-4fde-4238-865c-a8eeb5bb323f service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Refreshing network info cache for port c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Start _get_guest_xml network_info=[{"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:50:16 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:50:16 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1349886952',display_name='tempest-VolumesActionsTest-instance-1349886952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1349886952',id=30,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191f0dcc776c4b39854429de2da2f6b6',ramdisk_id='',reservation_id='r-zl8y6mq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-742523305',owner_user_name='tempest-VolumesActionsTest-742523305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:50:15Z,user_data=None,user_id='ff4914c45f8d42769609be5b8efac117',uuid=8e272771-2827-400d-a7f9-d785c158dcf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converting VIF {"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:14:6f,bridge_name='br-int',has_traffic_filtering=True,id=c6f1a42c-92a2-49f0-a3f6-77904c10bec4,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1a42c-92') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.objects.instance [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e272771-2827-400d-a7f9-d785c158dcf3 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:50:16 user nova-compute[74241]:   <uuid>8e272771-2827-400d-a7f9-d785c158dcf3</uuid>
Oct 20 11:50:16 user nova-compute[74241]:   <name>instance-0000001e</name>
Oct 20 11:50:16 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:50:16 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:50:16 user nova-compute[74241]:   <metadata>
Oct 20 11:50:16 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:50:16 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:50:16 user nova-compute[74241]:       <nova:name>tempest-VolumesActionsTest-instance-1349886952</nova:name>
Oct 20 11:50:16 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:50:16</nova:creationTime>
Oct 20 11:50:16 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:50:16 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:50:16 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:50:16 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:50:16 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:50:16 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:50:16 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:50:16 user nova-compute[74241]:       <nova:owner>
Oct 20 11:50:16 user nova-compute[74241]:         <nova:user uuid="ff4914c45f8d42769609be5b8efac117">tempest-VolumesActionsTest-742523305-project-member</nova:user>
Oct 20 11:50:16 user nova-compute[74241]:         <nova:project uuid="191f0dcc776c4b39854429de2da2f6b6">tempest-VolumesActionsTest-742523305</nova:project>
Oct 20 11:50:16 user nova-compute[74241]:       </nova:owner>
Oct 20 11:50:16 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:50:16 user nova-compute[74241]:       <nova:ports>
Oct 20 11:50:16 user nova-compute[74241]:         <nova:port uuid="c6f1a42c-92a2-49f0-a3f6-77904c10bec4">
Oct 20 11:50:16 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 11:50:16 user nova-compute[74241]:         </nova:port>
Oct 20 11:50:16 user nova-compute[74241]:       </nova:ports>
Oct 20 11:50:16 user nova-compute[74241]:     </nova:instance>
Oct 20 11:50:16 user nova-compute[74241]:   </metadata>
Oct 20 11:50:16 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:50:16 user nova-compute[74241]:     <system>
Oct 20 11:50:16 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:50:16 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:50:16 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:50:16 user nova-compute[74241]:       <entry name="serial">8e272771-2827-400d-a7f9-d785c158dcf3</entry>
Oct 20 11:50:16 user nova-compute[74241]:       <entry name="uuid">8e272771-2827-400d-a7f9-d785c158dcf3</entry>
Oct 20 11:50:16 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:50:16 user nova-compute[74241]:     </system>
Oct 20 11:50:16 user nova-compute[74241]:   </sysinfo>
Oct 20 11:50:16 user nova-compute[74241]:   <os>
Oct 20 11:50:16 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:50:16 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:50:16 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:50:16 user nova-compute[74241]:   </os>
Oct 20 11:50:16 user nova-compute[74241]:   <features>
Oct 20 11:50:16 user nova-compute[74241]:     <acpi/>
Oct 20 11:50:16 user nova-compute[74241]:     <apic/>
Oct 20 11:50:16 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:50:16 user nova-compute[74241]:   </features>
Oct 20 11:50:16 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:50:16 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:50:16 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:50:16 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:50:16 user nova-compute[74241]:   </clock>
Oct 20 11:50:16 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:50:16 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:50:16 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:50:16 user nova-compute[74241]:   </cpu>
Oct 20 11:50:16 user nova-compute[74241]:   <devices>
Oct 20 11:50:16 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:50:16 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:50:16 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk"/>
Oct 20 11:50:16 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:50:16 user nova-compute[74241]:     </disk>
Oct 20 11:50:16 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:50:16 user nova-compute[74241]:       <mac address="fa:16:3e:e1:14:6f"/>
Oct 20 11:50:16 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:50:16 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:50:16 user nova-compute[74241]:       <target dev="tapc6f1a42c-92"/>
Oct 20 11:50:16 user nova-compute[74241]:     </interface>
Oct 20 11:50:16 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:50:16 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/console.log" append="off"/>
Oct 20 11:50:16 user nova-compute[74241]:     </serial>
Oct 20 11:50:16 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:50:16 user nova-compute[74241]:     <video>
Oct 20 11:50:16 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:50:16 user nova-compute[74241]:     </video>
Oct 20 11:50:16 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:50:16 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:50:16 user nova-compute[74241]:     </rng>
Oct 20 11:50:16 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:50:16 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:50:16 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:50:16 user nova-compute[74241]:     </memballoon>
Oct 20 11:50:16 user nova-compute[74241]:   </devices>
Oct 20 11:50:16 user nova-compute[74241]: </domain>
Oct 20 11:50:16 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1349886952',display_name='tempest-VolumesActionsTest-instance-1349886952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1349886952',id=30,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191f0dcc776c4b39854429de2da2f6b6',ramdisk_id='',reservation_id='r-zl8y6mq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-742523305',owner_user_name='tempest-VolumesActionsTest-742523305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:50:15Z,user_data=None,user_id='ff4914c45f8d42769609be5b8efac117',uuid=8e272771-2827-400d-a7f9-d785c158dcf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converting VIF {"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:14:6f,bridge_name='br-int',has_traffic_filtering=True,id=c6f1a42c-92a2-49f0-a3f6-77904c10bec4,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1a42c-92') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG os_vif [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:14:6f,bridge_name='br-int',has_traffic_filtering=True,id=c6f1a42c-92a2-49f0-a3f6-77904c10bec4,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1a42c-92') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de9159e0-1b7d-5a1d-8fc5-e990686fd239', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6f1a42c-92, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6f1a42c-92, col_values=(('qos', UUID('7e6a1ba5-4156-428c-ac95-531a18a2a870')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6f1a42c-92, col_values=(('external_ids', {'iface-id': 'c6f1a42c-92a2-49f0-a3f6-77904c10bec4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:14:6f', 'vm-uuid': '8e272771-2827-400d-a7f9-d785c158dcf3'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:16 user nova-compute[74241]: INFO os_vif [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:14:6f,bridge_name='br-int',has_traffic_filtering=True,id=c6f1a42c-92a2-49f0-a3f6-77904c10bec4,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1a42c-92')
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] No VIF found with MAC fa:16:3e:e1:14:6f, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-d582bc64-46c9-44e1-9c76-d31f486119da req-16cb9a81-4fde-4238-865c-a8eeb5bb323f service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Updated VIF entry in instance network info cache for port c6f1a42c-92a2-49f0-a3f6-77904c10bec4. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-d582bc64-46c9-44e1-9c76-d31f486119da req-16cb9a81-4fde-4238-865c-a8eeb5bb323f service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Updating instance_info_cache with network_info: [{"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:50:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d582bc64-46c9-44e1-9c76-d31f486119da req-16cb9a81-4fde-4238-865c-a8eeb5bb323f service nova] Releasing lock "refresh_cache-8e272771-2827-400d-a7f9-d785c158dcf3" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:50:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-78b02830-720c-4895-abb4-a2248d8c5e31 req-68b27b7d-931d-4bef-8ad9-97b1a028e3cf service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received event network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:50:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78b02830-720c-4895-abb4-a2248d8c5e31 req-68b27b7d-931d-4bef-8ad9-97b1a028e3cf service nova] Acquiring lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78b02830-720c-4895-abb4-a2248d8c5e31 req-68b27b7d-931d-4bef-8ad9-97b1a028e3cf service nova] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78b02830-720c-4895-abb4-a2248d8c5e31 req-68b27b7d-931d-4bef-8ad9-97b1a028e3cf service nova] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-78b02830-720c-4895-abb4-a2248d8c5e31 req-68b27b7d-931d-4bef-8ad9-97b1a028e3cf service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] No waiting events found dispatching network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:50:18 user nova-compute[74241]: WARNING nova.compute.manager [req-78b02830-720c-4895-abb4-a2248d8c5e31 req-68b27b7d-931d-4bef-8ad9-97b1a028e3cf service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received unexpected event network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 for instance with vm_state building and task_state spawning.
Oct 20 11:50:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:50:20 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Instance spawned successfully.
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:20 user nova-compute[74241]: INFO nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:50:20 user nova-compute[74241]: INFO nova.compute.manager [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Took 6.10 seconds to build instance.
Oct 20 11:50:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b9b2d114-4043-45ae-9d29-a6ca6371737e tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "8e272771-2827-400d-a7f9-d785c158dcf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.188s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-e192109d-3e66-4370-9ad1-8cfb5c110b39 req-6052e156-c8a5-4422-b19f-fc3d001edd44 service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received event network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e192109d-3e66-4370-9ad1-8cfb5c110b39 req-6052e156-c8a5-4422-b19f-fc3d001edd44 service nova] Acquiring lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e192109d-3e66-4370-9ad1-8cfb5c110b39 req-6052e156-c8a5-4422-b19f-fc3d001edd44 service nova] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e192109d-3e66-4370-9ad1-8cfb5c110b39 req-6052e156-c8a5-4422-b19f-fc3d001edd44 service nova] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-e192109d-3e66-4370-9ad1-8cfb5c110b39 req-6052e156-c8a5-4422-b19f-fc3d001edd44 service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] No waiting events found dispatching network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:50:20 user nova-compute[74241]: WARNING nova.compute.manager [req-e192109d-3e66-4370-9ad1-8cfb5c110b39 req-6052e156-c8a5-4422-b19f-fc3d001edd44 service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received unexpected event network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 for instance with vm_state active and task_state None.
Oct 20 11:50:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Going to confirm migration 2 {{(pid=74241) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 20 11:50:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:50:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquired lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:50:22 user nova-compute[74241]: DEBUG nova.network.neutron [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:50:22 user nova-compute[74241]: DEBUG nova.objects.instance [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'info_cache' on Instance uuid ec07982b-d7ea-4950-aca1-c6120927cfb0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG nova.network.neutron [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating instance_info_cache with network_info: [{"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Releasing lock "refresh_cache-ec07982b-d7ea-4950-aca1-c6120927cfb0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG nova.objects.instance [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'migration_context' on Instance uuid ec07982b-d7ea-4950-aca1-c6120927cfb0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG nova.objects.base [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Object Instance<ec07982b-d7ea-4950-aca1-c6120927cfb0> lazy-loaded attributes: info_cache,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:50:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.405s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:24 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Deleted allocation for migration 686ac838-dea4-4426-b7f5-e0116a32ff2c
Oct 20 11:50:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e497b3f0-a65c-4c29-8322-391177384f74 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.438s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:50:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquired lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:50:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:50:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'info_cache' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:24 user nova-compute[74241]: DEBUG nova.objects.base [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating instance_info_cache with network_info: [{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Releasing lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:50:25 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance destroyed successfully.
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'resources' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.base [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG os_vif [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd970e2bd-a0, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a2e0b0f-6d1d-43e2-bce9-0b8589615c0e) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:25 user nova-compute[74241]: INFO os_vif [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0')
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Start _get_guest_xml network_info=[{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'numa_topology' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.base [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:50:25 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:50:25 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'vcpu_model' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.base [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'pci_devices' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.base [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:50:25 user nova-compute[74241]:   <uuid>333dae7f-9914-4604-a36b-8e5d4d2a4bce</uuid>
Oct 20 11:50:25 user nova-compute[74241]:   <name>instance-00000013</name>
Oct 20 11:50:25 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:50:25 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:50:25 user nova-compute[74241]:   <metadata>
Oct 20 11:50:25 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:50:25 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:50:25 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeTestJSON-server-1214393435</nova:name>
Oct 20 11:50:25 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:50:25</nova:creationTime>
Oct 20 11:50:25 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:50:25 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:50:25 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:50:25 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:50:25 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:50:25 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:50:25 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:50:25 user nova-compute[74241]:       <nova:owner>
Oct 20 11:50:25 user nova-compute[74241]:         <nova:user uuid="8f2c95648d124219b0505d18ebc85f5d">tempest-AttachVolumeTestJSON-1958556215-project-member</nova:user>
Oct 20 11:50:25 user nova-compute[74241]:         <nova:project uuid="2181a0d9a273487eaa81ad8acd48c8e9">tempest-AttachVolumeTestJSON-1958556215</nova:project>
Oct 20 11:50:25 user nova-compute[74241]:       </nova:owner>
Oct 20 11:50:25 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:50:25 user nova-compute[74241]:       <nova:ports>
Oct 20 11:50:25 user nova-compute[74241]:         <nova:port uuid="d970e2bd-a050-4038-afec-cb86392153c9">
Oct 20 11:50:25 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 11:50:25 user nova-compute[74241]:         </nova:port>
Oct 20 11:50:25 user nova-compute[74241]:       </nova:ports>
Oct 20 11:50:25 user nova-compute[74241]:     </nova:instance>
Oct 20 11:50:25 user nova-compute[74241]:   </metadata>
Oct 20 11:50:25 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:50:25 user nova-compute[74241]:     <system>
Oct 20 11:50:25 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:50:25 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:50:25 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:50:25 user nova-compute[74241]:       <entry name="serial">333dae7f-9914-4604-a36b-8e5d4d2a4bce</entry>
Oct 20 11:50:25 user nova-compute[74241]:       <entry name="uuid">333dae7f-9914-4604-a36b-8e5d4d2a4bce</entry>
Oct 20 11:50:25 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:50:25 user nova-compute[74241]:     </system>
Oct 20 11:50:25 user nova-compute[74241]:   </sysinfo>
Oct 20 11:50:25 user nova-compute[74241]:   <os>
Oct 20 11:50:25 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:50:25 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:50:25 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:50:25 user nova-compute[74241]:   </os>
Oct 20 11:50:25 user nova-compute[74241]:   <features>
Oct 20 11:50:25 user nova-compute[74241]:     <acpi/>
Oct 20 11:50:25 user nova-compute[74241]:     <apic/>
Oct 20 11:50:25 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:50:25 user nova-compute[74241]:   </features>
Oct 20 11:50:25 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:50:25 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:50:25 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:50:25 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:50:25 user nova-compute[74241]:   </clock>
Oct 20 11:50:25 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:50:25 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:50:25 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:50:25 user nova-compute[74241]:   </cpu>
Oct 20 11:50:25 user nova-compute[74241]:   <devices>
Oct 20 11:50:25 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:50:25 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:50:25 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk"/>
Oct 20 11:50:25 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:50:25 user nova-compute[74241]:     </disk>
Oct 20 11:50:25 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:50:25 user nova-compute[74241]:       <mac address="fa:16:3e:4d:4b:43"/>
Oct 20 11:50:25 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:50:25 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:50:25 user nova-compute[74241]:       <target dev="tapd970e2bd-a0"/>
Oct 20 11:50:25 user nova-compute[74241]:     </interface>
Oct 20 11:50:25 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:50:25 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/console.log" append="off"/>
Oct 20 11:50:25 user nova-compute[74241]:     </serial>
Oct 20 11:50:25 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:50:25 user nova-compute[74241]:     <video>
Oct 20 11:50:25 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:50:25 user nova-compute[74241]:     </video>
Oct 20 11:50:25 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:50:25 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:50:25 user nova-compute[74241]:     </rng>
Oct 20 11:50:25 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:50:25 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:50:25 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:50:25 user nova-compute[74241]:     </memballoon>
Oct 20 11:50:25 user nova-compute[74241]:   </devices>
Oct 20 11:50:25 user nova-compute[74241]: </domain>
Oct 20 11:50:25 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'trusted_certs' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG nova.objects.base [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:50:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Cannot resize image /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'migration_context' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG nova.objects.base [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Object Instance<333dae7f-9914-4604-a36b-8e5d4d2a4bce> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:48:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG os_vif [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb8e2e0b-e8cf-527f-bbf2-270b077c0895', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd970e2bd-a0, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd970e2bd-a0, col_values=(('qos', UUID('ad8cdf0b-fc35-4840-95ab-bb183abb6562')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd970e2bd-a0, col_values=(('external_ids', {'iface-id': 'd970e2bd-a050-4038-afec-cb86392153c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:4b:43', 'vm-uuid': '333dae7f-9914-4604-a36b-8e5d4d2a4bce'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:50:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:26 user nova-compute[74241]: INFO os_vif [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0')
Oct 20 11:50:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-5895f178-ddee-4463-a0f6-ad2ecf2d5ddd req-a4003b20-d7bd-4ef3-a6a9-b26cc3278c1e service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:50:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5895f178-ddee-4463-a0f6-ad2ecf2d5ddd req-a4003b20-d7bd-4ef3-a6a9-b26cc3278c1e service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5895f178-ddee-4463-a0f6-ad2ecf2d5ddd req-a4003b20-d7bd-4ef3-a6a9-b26cc3278c1e service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5895f178-ddee-4463-a0f6-ad2ecf2d5ddd req-a4003b20-d7bd-4ef3-a6a9-b26cc3278c1e service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-5895f178-ddee-4463-a0f6-ad2ecf2d5ddd req-a4003b20-d7bd-4ef3-a6a9-b26cc3278c1e service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:50:27 user nova-compute[74241]: WARNING nova.compute.manager [req-5895f178-ddee-4463-a0f6-ad2ecf2d5ddd req-a4003b20-d7bd-4ef3-a6a9-b26cc3278c1e service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state stopped and task_state powering-on.
Oct 20 11:50:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:50:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance rebooted successfully.
Oct 20 11:50:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2730fc4d-b0f7-49c4-94ee-1b60320ac0e7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:50:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-55eabc22-bef5-4fea-bb1d-a4d8352eeb69 req-72eb57be-3187-4fac-9a34-1dd056be84cb service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:50:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-55eabc22-bef5-4fea-bb1d-a4d8352eeb69 req-72eb57be-3187-4fac-9a34-1dd056be84cb service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-55eabc22-bef5-4fea-bb1d-a4d8352eeb69 req-72eb57be-3187-4fac-9a34-1dd056be84cb service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-55eabc22-bef5-4fea-bb1d-a4d8352eeb69 req-72eb57be-3187-4fac-9a34-1dd056be84cb service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-55eabc22-bef5-4fea-bb1d-a4d8352eeb69 req-72eb57be-3187-4fac-9a34-1dd056be84cb service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:50:29 user nova-compute[74241]: WARNING nova.compute.manager [req-55eabc22-bef5-4fea-bb1d-a4d8352eeb69 req-72eb57be-3187-4fac-9a34-1dd056be84cb service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state stopped and task_state powering-on.
Oct 20 11:50:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:50:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:50:52 user nova-compute[74241]: INFO nova.compute.claims [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Claim successful on node user
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:50:53 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.policy [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ad19e5d57684ea2ae450fcc53ca8bd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b379f1e29f94071a26728bdb59bbfcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:50:53 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Creating image(s)
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk 1073741824" returned: 0 in 0.052s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Successfully created port: d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:50:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Cannot resize image /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Ensure instance console log exists: /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Successfully updated port: d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquired lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-27778f0a-bd61-4611-a946-c7624b928c09 req-16d8f6b4-e171-46a2-82bf-3ed2514ce175 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-changed-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-27778f0a-bd61-4611-a946-c7624b928c09 req-16d8f6b4-e171-46a2-82bf-3ed2514ce175 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Refreshing instance network info cache due to event network-changed-d7f9f66f-674b-41d6-9460-5f0be423b6d1. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27778f0a-bd61-4611-a946-c7624b928c09 req-16d8f6b4-e171-46a2-82bf-3ed2514ce175 service nova] Acquiring lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Releasing lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance network_info: |[{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27778f0a-bd61-4611-a946-c7624b928c09 req-16d8f6b4-e171-46a2-82bf-3ed2514ce175 service nova] Acquired lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.network.neutron [req-27778f0a-bd61-4611-a946-c7624b928c09 req-16d8f6b4-e171-46a2-82bf-3ed2514ce175 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Refreshing network info cache for port d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:50:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Start _get_guest_xml network_info=[{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:50:55 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:50:55 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-550887458',display_name='tempest-ServerRescueNegativeTestJSON-server-550887458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-550887458',id=31,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE97RzNueek15qvzFipBWLRsLZQicogNQi2U1snsTzV3Rlzzpvue1LEwiFCPaIiUMWBmryDPeNhiqsYhY3dRen8M1Ue/Y27ILFXFAoMJAr7pdJBrh/acghFPHguk3gSUAw==',key_name='tempest-keypair-1249799456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-4srw336e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=e1bd5ec5-ad87-45bd-ba69-ad979258a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:10:a9,bridge_name='br-int',has_traffic_filtering=True,id=d7f9f66f-674b-41d6-9460-5f0be423b6d1,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f9f66f-67') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'pci_devices' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:50:55 user nova-compute[74241]:   <uuid>e1bd5ec5-ad87-45bd-ba69-ad979258a9be</uuid>
Oct 20 11:50:55 user nova-compute[74241]:   <name>instance-0000001f</name>
Oct 20 11:50:55 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:50:55 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:50:55 user nova-compute[74241]:   <metadata>
Oct 20 11:50:55 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:50:55 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:50:55 user nova-compute[74241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-550887458</nova:name>
Oct 20 11:50:55 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:50:55</nova:creationTime>
Oct 20 11:50:55 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:50:55 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:50:55 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:50:55 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:50:55 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:50:55 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:50:55 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:50:55 user nova-compute[74241]:       <nova:owner>
Oct 20 11:50:55 user nova-compute[74241]:         <nova:user uuid="6ad19e5d57684ea2ae450fcc53ca8bd7">tempest-ServerRescueNegativeTestJSON-1505666936-project-member</nova:user>
Oct 20 11:50:55 user nova-compute[74241]:         <nova:project uuid="6b379f1e29f94071a26728bdb59bbfcb">tempest-ServerRescueNegativeTestJSON-1505666936</nova:project>
Oct 20 11:50:55 user nova-compute[74241]:       </nova:owner>
Oct 20 11:50:55 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:50:55 user nova-compute[74241]:       <nova:ports>
Oct 20 11:50:55 user nova-compute[74241]:         <nova:port uuid="d7f9f66f-674b-41d6-9460-5f0be423b6d1">
Oct 20 11:50:55 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 11:50:55 user nova-compute[74241]:         </nova:port>
Oct 20 11:50:55 user nova-compute[74241]:       </nova:ports>
Oct 20 11:50:55 user nova-compute[74241]:     </nova:instance>
Oct 20 11:50:55 user nova-compute[74241]:   </metadata>
Oct 20 11:50:55 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:50:55 user nova-compute[74241]:     <system>
Oct 20 11:50:55 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:50:55 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:50:55 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:50:55 user nova-compute[74241]:       <entry name="serial">e1bd5ec5-ad87-45bd-ba69-ad979258a9be</entry>
Oct 20 11:50:55 user nova-compute[74241]:       <entry name="uuid">e1bd5ec5-ad87-45bd-ba69-ad979258a9be</entry>
Oct 20 11:50:55 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:50:55 user nova-compute[74241]:     </system>
Oct 20 11:50:55 user nova-compute[74241]:   </sysinfo>
Oct 20 11:50:55 user nova-compute[74241]:   <os>
Oct 20 11:50:55 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:50:55 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:50:55 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:50:55 user nova-compute[74241]:   </os>
Oct 20 11:50:55 user nova-compute[74241]:   <features>
Oct 20 11:50:55 user nova-compute[74241]:     <acpi/>
Oct 20 11:50:55 user nova-compute[74241]:     <apic/>
Oct 20 11:50:55 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:50:55 user nova-compute[74241]:   </features>
Oct 20 11:50:55 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:50:55 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:50:55 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:50:55 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:50:55 user nova-compute[74241]:   </clock>
Oct 20 11:50:55 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:50:55 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:50:55 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:50:55 user nova-compute[74241]:   </cpu>
Oct 20 11:50:55 user nova-compute[74241]:   <devices>
Oct 20 11:50:55 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:50:55 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:50:55 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk"/>
Oct 20 11:50:55 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:50:55 user nova-compute[74241]:     </disk>
Oct 20 11:50:55 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:50:55 user nova-compute[74241]:       <mac address="fa:16:3e:38:10:a9"/>
Oct 20 11:50:55 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:50:55 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:50:55 user nova-compute[74241]:       <target dev="tapd7f9f66f-67"/>
Oct 20 11:50:55 user nova-compute[74241]:     </interface>
Oct 20 11:50:55 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:50:55 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/console.log" append="off"/>
Oct 20 11:50:55 user nova-compute[74241]:     </serial>
Oct 20 11:50:55 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:50:55 user nova-compute[74241]:     <video>
Oct 20 11:50:55 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:50:55 user nova-compute[74241]:     </video>
Oct 20 11:50:55 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:50:55 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:50:55 user nova-compute[74241]:     </rng>
Oct 20 11:50:55 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:50:55 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:50:55 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:50:55 user nova-compute[74241]:     </memballoon>
Oct 20 11:50:55 user nova-compute[74241]:   </devices>
Oct 20 11:50:55 user nova-compute[74241]: </domain>
Oct 20 11:50:55 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-550887458',display_name='tempest-ServerRescueNegativeTestJSON-server-550887458',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-550887458',id=31,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE97RzNueek15qvzFipBWLRsLZQicogNQi2U1snsTzV3Rlzzpvue1LEwiFCPaIiUMWBmryDPeNhiqsYhY3dRen8M1Ue/Y27ILFXFAoMJAr7pdJBrh/acghFPHguk3gSUAw==',key_name='tempest-keypair-1249799456',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-4srw336e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=e1bd5ec5-ad87-45bd-ba69-ad979258a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:10:a9,bridge_name='br-int',has_traffic_filtering=True,id=d7f9f66f-674b-41d6-9460-5f0be423b6d1,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f9f66f-67') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG os_vif [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:10:a9,bridge_name='br-int',has_traffic_filtering=True,id=d7f9f66f-674b-41d6-9460-5f0be423b6d1,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f9f66f-67') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '19ac1379-a9f2-5314-8da0-b46f03f942d8', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7f9f66f-67, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7f9f66f-67, col_values=(('qos', UUID('cf1025cd-5478-40f5-bdcb-c4dc8ac1a237')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7f9f66f-67, col_values=(('external_ids', {'iface-id': 'd7f9f66f-674b-41d6-9460-5f0be423b6d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:10:a9', 'vm-uuid': 'e1bd5ec5-ad87-45bd-ba69-ad979258a9be'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:55 user nova-compute[74241]: INFO os_vif [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:10:a9,bridge_name='br-int',has_traffic_filtering=True,id=d7f9f66f-674b-41d6-9460-5f0be423b6d1,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f9f66f-67')
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No VIF found with MAC fa:16:3e:38:10:a9, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.network.neutron [req-27778f0a-bd61-4611-a946-c7624b928c09 req-16d8f6b4-e171-46a2-82bf-3ed2514ce175 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updated VIF entry in instance network info cache for port d7f9f66f-674b-41d6-9460-5f0be423b6d1. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG nova.network.neutron [req-27778f0a-bd61-4611-a946-c7624b928c09 req-16d8f6b4-e171-46a2-82bf-3ed2514ce175 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:50:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-27778f0a-bd61-4611-a946-c7624b928c09 req-16d8f6b4-e171-46a2-82bf-3ed2514ce175 service nova] Releasing lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-a9462440-bd76-49f8-befa-a8d9d5b7c082 req-e9d0a049-dc44-41ec-8e14-c5224df59dd5 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a9462440-bd76-49f8-befa-a8d9d5b7c082 req-e9d0a049-dc44-41ec-8e14-c5224df59dd5 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a9462440-bd76-49f8-befa-a8d9d5b7c082 req-e9d0a049-dc44-41ec-8e14-c5224df59dd5 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a9462440-bd76-49f8-befa-a8d9d5b7c082 req-e9d0a049-dc44-41ec-8e14-c5224df59dd5 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-a9462440-bd76-49f8-befa-a8d9d5b7c082 req-e9d0a049-dc44-41ec-8e14-c5224df59dd5 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:50:56 user nova-compute[74241]: WARNING nova.compute.manager [req-a9462440-bd76-49f8-befa-a8d9d5b7c082 req-e9d0a049-dc44-41ec-8e14-c5224df59dd5 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state building and task_state spawning.
Oct 20 11:50:56 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:50:57 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:50:58 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance spawned successfully.
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c5ca405-d2eb-4e81-b42d-aa3af62274bf req-79805a8a-bb56-4522-89e6-1bee7ef3cb17 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c5ca405-d2eb-4e81-b42d-aa3af62274bf req-79805a8a-bb56-4522-89e6-1bee7ef3cb17 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c5ca405-d2eb-4e81-b42d-aa3af62274bf req-79805a8a-bb56-4522-89e6-1bee7ef3cb17 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c5ca405-d2eb-4e81-b42d-aa3af62274bf req-79805a8a-bb56-4522-89e6-1bee7ef3cb17 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c5ca405-d2eb-4e81-b42d-aa3af62274bf req-79805a8a-bb56-4522-89e6-1bee7ef3cb17 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:50:58 user nova-compute[74241]: WARNING nova.compute.manager [req-3c5ca405-d2eb-4e81-b42d-aa3af62274bf req-79805a8a-bb56-4522-89e6-1bee7ef3cb17 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state building and task_state spawning.
Oct 20 11:50:58 user nova-compute[74241]: INFO nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Took 5.49 seconds to spawn the instance on the hypervisor.
Oct 20 11:50:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:50:58 user nova-compute[74241]: INFO nova.compute.manager [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Took 6.21 seconds to build instance.
Oct 20 11:50:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f006c95c-f142-408b-bbc0-73f77d19d5df tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.332s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:50:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:50:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:50:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:50:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:50:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:51:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:04 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:51:04 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7387MB free_disk=25.307453155517578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 743736c6-e1de-4f11-bc3c-09194744e60e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e0723ef5-96db-4191-84da-05eab21e5837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8e272771-2827-400d-a7f9-d785c158dcf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:51:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:51:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.492s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid f289e23f-cab7-4631-9c80-6b0391bbea89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [{"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f289e23f-cab7-4631-9c80-6b0391bbea89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:51:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:51:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:51:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:51:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:51:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:51:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG nova.objects.instance [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'flavor' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:12 user nova-compute[74241]: INFO nova.compute.manager [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Attaching volume acb3a9db-471d-4232-a95c-a21d445912b0 to /dev/vdb
Oct 20 11:51:12 user nova-compute[74241]: DEBUG os_brick.utils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e7ef32-0ea5-4712-9cef-b09c283f4600]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8258e8-1445-4b7f-9075-064e2d76ae60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17c3e5b-8b76-4a3d-b81a-9008b45d174b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59c40a6-e76d-43d4-9702-787073c5c6d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:51:13 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:51:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b70729-841c-4261-83c6-c02c92f40fe6]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG os_brick.utils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:51:13 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating existing volume attachment record: 513f5b81-9dce-476f-85db-ebf48fcd0272 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:51:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-78eca7ee-c093-4b79-9fad-83c2014d9483 req-6028c05b-161a-42d6-8e71-2dcd37f752f6 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received event network-changed-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:51:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-78eca7ee-c093-4b79-9fad-83c2014d9483 req-6028c05b-161a-42d6-8e71-2dcd37f752f6 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Refreshing instance network info cache due to event network-changed-135ab84c-fb70-47b9-a4ff-1d29c9f61018. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:51:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78eca7ee-c093-4b79-9fad-83c2014d9483 req-6028c05b-161a-42d6-8e71-2dcd37f752f6 service nova] Acquiring lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:51:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78eca7ee-c093-4b79-9fad-83c2014d9483 req-6028c05b-161a-42d6-8e71-2dcd37f752f6 service nova] Acquired lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:51:23 user nova-compute[74241]: DEBUG nova.network.neutron [req-78eca7ee-c093-4b79-9fad-83c2014d9483 req-6028c05b-161a-42d6-8e71-2dcd37f752f6 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Refreshing network info cache for port 135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:51:24 user nova-compute[74241]: DEBUG nova.network.neutron [req-78eca7ee-c093-4b79-9fad-83c2014d9483 req-6028c05b-161a-42d6-8e71-2dcd37f752f6 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Updated VIF entry in instance network info cache for port 135ab84c-fb70-47b9-a4ff-1d29c9f61018. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:51:24 user nova-compute[74241]: DEBUG nova.network.neutron [req-78eca7ee-c093-4b79-9fad-83c2014d9483 req-6028c05b-161a-42d6-8e71-2dcd37f752f6 service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Updating instance_info_cache with network_info: [{"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:51:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-78eca7ee-c093-4b79-9fad-83c2014d9483 req-6028c05b-161a-42d6-8e71-2dcd37f752f6 service nova] Releasing lock "refresh_cache-743736c6-e1de-4f11-bc3c-09194744e60e" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:51:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-ee5f7266-bc0e-4178-b51a-dfdcc8990393 req-796b63c5-f2ee-48f1-aaba-ff585da3dbe9 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received event network-changed-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:51:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-ee5f7266-bc0e-4178-b51a-dfdcc8990393 req-796b63c5-f2ee-48f1-aaba-ff585da3dbe9 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Refreshing instance network info cache due to event network-changed-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:51:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ee5f7266-bc0e-4178-b51a-dfdcc8990393 req-796b63c5-f2ee-48f1-aaba-ff585da3dbe9 service nova] Acquiring lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:51:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ee5f7266-bc0e-4178-b51a-dfdcc8990393 req-796b63c5-f2ee-48f1-aaba-ff585da3dbe9 service nova] Acquired lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:51:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-ee5f7266-bc0e-4178-b51a-dfdcc8990393 req-796b63c5-f2ee-48f1-aaba-ff585da3dbe9 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Refreshing network info cache for port 3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moZdWGMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:51:33 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:51:33 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:51:33 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6890f2-008a-402d-9194-a6099dbcc90f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:51:33 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG nova.objects.instance [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'flavor' on Instance uuid e0723ef5-96db-4191-84da-05eab21e5837 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f84394-79c3-4d1f-9349-fa57f6067e83]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0] added
Oct 20 11:51:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Ignoring supplied device name: /dev/vdb
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aeedec-0d9b-4170-9467-53561a23560d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[295448ac-2fda-4543-994f-ab0f2a90dc57]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moZdWGMn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moZdWGMn" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fb7df9-7dfd-49ec-935a-fc38f393bb33]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'moZdWGMn'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: INFO nova.compute.manager [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] instance snapshotting
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d24bc1d-b873-4f1a-ac37-9342beff16d6]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c14a63-b41a-4442-a0cf-809b1c6e9036]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:51:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:51:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Beginning live snapshot process
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:33 user nova-compute[74241]: INFO nova.compute.manager [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Attaching volume da9ea5e2-01dd-4e42-a98f-ba347f5f3711 to /dev/vdb
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b45e0-c7e5-4b15-9c9f-420852d79515]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260]
Oct 20 11:51:33 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260] successful.
Oct 20 11:51:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-ee5f7266-bc0e-4178-b51a-dfdcc8990393 req-796b63c5-f2ee-48f1-aaba-ff585da3dbe9 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Updated VIF entry in instance network info cache for port 3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-ee5f7266-bc0e-4178-b51a-dfdcc8990393 req-796b63c5-f2ee-48f1-aaba-ff585da3dbe9 service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Updating instance_info_cache with network_info: [{"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce0c3ef-dc0a-4e2e-bbd5-63df9e8aa55c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ee5f7266-bc0e-4178-b51a-dfdcc8990393 req-796b63c5-f2ee-48f1-aaba-ff585da3dbe9 service nova] Releasing lock "refresh_cache-e0723ef5-96db-4191-84da-05eab21e5837" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5012dcde-6f98-4fec-b10c-b8abd463919c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:51:33 user nova-compute[74241]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:51:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:51:33 user nova-compute[74241]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:51:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.utils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e8c8ef-894d-46ac-83b8-82c7982ffa45]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moZdWGMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[379af34d-c160-46a8-85c9-2b8a1502a311]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c960e-e280-4ca8-bbd8-db6389a00ecf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84d8102-f94b-42a2-aad1-d51c69dec50f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea99fe33-3dd8-4dbe-8c04-f967ad8fd321]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json -f qcow2 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:51:33 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d371737f-5cad-41a8-89c8-93d7465e8501]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG os_brick.utils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Updating existing volume attachment record: 6a76e093-d534-445a-9346-6459ba5ec36f {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json -f qcow2 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 743736c6-e1de-4f11-bc3c-09194744e60e {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:34 user nova-compute[74241]: INFO nova.compute.manager [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Attaching volume ab385904-c116-4262-8c48-101b06b8de4f to /dev/vdb
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2r42q1un/7c45213e27664619b343789847fc64ad.delta 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG os_brick.utils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2r42q1un/7c45213e27664619b343789847fc64ad.delta 1073741824" returned: 0 in 0.056s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0550c15-f124-42b8-b690-4aa833f29069]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac83417-a903-4a4a-bcc1-00e5819fab9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0683f0ab-e333-45f4-b79b-35220809770b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[85faa5a1-3639-4dcd-9e6f-448c9fdc0a80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:51:34 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:51:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ae6c6e-3bb0-4f32-98b3-d07b0b123383]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG os_brick.utils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Updating existing volume attachment record: c3b230b7-5201-4cbb-815f-e16dcaf5b83f {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23239333433363434', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239333433363434', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG nova.objects.instance [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'flavor' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:51:34 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:51:34 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:51:34 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:51:34 user nova-compute[74241]:   <serial>acb3a9db-471d-4232-a95c-a21d445912b0</serial>
Oct 20 11:51:34 user nova-compute[74241]: </disk>
Oct 20 11:51:34 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:51:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:51:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:51:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:51:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No VIF found with MAC fa:16:3e:54:e1:43, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:51:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 11:51:35 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 11:51:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5b2b5f50-e6f0-43ca-86c7-3bb240f2a174 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.589s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:51:35 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:51:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2r42q1un/7c45213e27664619b343789847fc64ad.delta /opt/stack/data/nova/instances/snapshots/tmp2r42q1un/7c45213e27664619b343789847fc64ad {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:51:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2r42q1un/7c45213e27664619b343789847fc64ad.delta /opt/stack/data/nova/instances/snapshots/tmp2r42q1un/7c45213e27664619b343789847fc64ad" returned: 0 in 0.659s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:51:36 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Snapshot extracted, beginning image upload
Oct 20 11:51:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:38 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Snapshot image upload complete
Oct 20 11:51:38 user nova-compute[74241]: INFO nova.compute.manager [None req-24dd12eb-bdbf-454e-9694-018444e70e75 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Took 5.46 seconds to snapshot the instance on the hypervisor.
Oct 20 11:51:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-57b02586-049d-47d8-9e6d-e1a5662def7d req-b87a8571-c328-45cd-b440-4c5936673b22 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:51:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-57b02586-049d-47d8-9e6d-e1a5662def7d req-b87a8571-c328-45cd-b440-4c5936673b22 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing instance network info cache due to event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:51:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-57b02586-049d-47d8-9e6d-e1a5662def7d req-b87a8571-c328-45cd-b440-4c5936673b22 service nova] Acquiring lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:51:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-57b02586-049d-47d8-9e6d-e1a5662def7d req-b87a8571-c328-45cd-b440-4c5936673b22 service nova] Acquired lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:51:47 user nova-compute[74241]: DEBUG nova.network.neutron [req-57b02586-049d-47d8-9e6d-e1a5662def7d req-b87a8571-c328-45cd-b440-4c5936673b22 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:51:47 user nova-compute[74241]: DEBUG nova.network.neutron [req-57b02586-049d-47d8-9e6d-e1a5662def7d req-b87a8571-c328-45cd-b440-4c5936673b22 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updated VIF entry in instance network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:51:47 user nova-compute[74241]: DEBUG nova.network.neutron [req-57b02586-049d-47d8-9e6d-e1a5662def7d req-b87a8571-c328-45cd-b440-4c5936673b22 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating instance_info_cache with network_info: [{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:51:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-57b02586-049d-47d8-9e6d-e1a5662def7d req-b87a8571-c328-45cd-b440-4c5936673b22 service nova] Releasing lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:51:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-67ca1adf-c7ab-42dd-9c29-f5b0920a399f req-22849ee3-6f99-4afb-8efe-eb88b8388a06 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:51:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-67ca1adf-c7ab-42dd-9c29-f5b0920a399f req-22849ee3-6f99-4afb-8efe-eb88b8388a06 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing instance network info cache due to event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:51:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-67ca1adf-c7ab-42dd-9c29-f5b0920a399f req-22849ee3-6f99-4afb-8efe-eb88b8388a06 service nova] Acquiring lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:51:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-67ca1adf-c7ab-42dd-9c29-f5b0920a399f req-22849ee3-6f99-4afb-8efe-eb88b8388a06 service nova] Acquired lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:51:49 user nova-compute[74241]: DEBUG nova.network.neutron [req-67ca1adf-c7ab-42dd-9c29-f5b0920a399f req-22849ee3-6f99-4afb-8efe-eb88b8388a06 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG nova.network.neutron [req-67ca1adf-c7ab-42dd-9c29-f5b0920a399f req-22849ee3-6f99-4afb-8efe-eb88b8388a06 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updated VIF entry in instance network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG nova.network.neutron [req-67ca1adf-c7ab-42dd-9c29-f5b0920a399f req-22849ee3-6f99-4afb-8efe-eb88b8388a06 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating instance_info_cache with network_info: [{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:51:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-67ca1adf-c7ab-42dd-9c29-f5b0920a399f req-22849ee3-6f99-4afb-8efe-eb88b8388a06 service nova] Releasing lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:51:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:59 user nova-compute[74241]: INFO nova.compute.manager [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Rebooting instance
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquired lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:51:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating instance_info_cache with network_info: [{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Releasing lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-ffb6f60d-d676-4f28-89bd-b4f82c297f76 req-2a494303-9fde-46f8-ac7b-0acddca3b0a9 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-unplugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ffb6f60d-d676-4f28-89bd-b4f82c297f76 req-2a494303-9fde-46f8-ac7b-0acddca3b0a9 service nova] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ffb6f60d-d676-4f28-89bd-b4f82c297f76 req-2a494303-9fde-46f8-ac7b-0acddca3b0a9 service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ffb6f60d-d676-4f28-89bd-b4f82c297f76 req-2a494303-9fde-46f8-ac7b-0acddca3b0a9 service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-ffb6f60d-d676-4f28-89bd-b4f82c297f76 req-2a494303-9fde-46f8-ac7b-0acddca3b0a9 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] No waiting events found dispatching network-vif-unplugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:52:00 user nova-compute[74241]: WARNING nova.compute.manager [req-ffb6f60d-d676-4f28-89bd-b4f82c297f76 req-2a494303-9fde-46f8-ac7b-0acddca3b0a9 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received unexpected event network-vif-unplugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Instance destroyed successfully.
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'resources' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-25201554',display_name='tempest-TestMinimumBasicScenario-server-25201554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-25201554',id=26,image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeMrMy/sg8XxWtYVyzeFxR7apHfoUn94/bg1fXss/Ic+vdCwCyawATmHr7tQMWjdJcw/9i3eMIb4VHHfQtc1ntaLqNp4C9Dkh99q7CMBGUWZcrFycpxkFPQJHKvbN6R7w==',key_name='tempest-TestMinimumBasicScenario-454614026',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-rnf101oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:52:00Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=5b6ea39f-b167-480f-a288-d9bcf55434d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_vif [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6096fc9-69, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46d24cfa-d9fa-48e2-a20c-ffdb90a2549a) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:52:01 user nova-compute[74241]: INFO os_vif [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69')
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moZdWGMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:52:01 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd427320-01fd-4285-8c42-7eff7d8442b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:52:01 user nova-compute[74241]: No targets found.
Oct 20 11:52:01 user nova-compute[74241]: iSNS:
Oct 20 11:52:01 user nova-compute[74241]: No targets found.
Oct 20 11:52:01 user nova-compute[74241]: STATIC:
Oct 20 11:52:01 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0
Oct 20 11:52:01 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:52:01 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:52:01 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a
Oct 20 11:52:01 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:52:01 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:52:01 user nova-compute[74241]: FIRMWARE:
Oct 20 11:52:01 user nova-compute[74241]: No targets found.
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:52:01 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:52:01 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4a78ad-7742-4ecd-981d-95e3937e4b8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad79c2f-9f86-4fb0-ac81-d90fbd43fa9c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:01 user nova-compute[74241]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:01 user nova-compute[74241]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5208656d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[750b903c-a943-45a2-a096-9e2750b8e85e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e8cbc-61d7-4e8d-b7d9-1c258765da2e]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4ef24f-b7d0-4674-9034-f01fdd0b4201]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.073s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a147d8a-fefb-42cf-87a8-b93c6b954b20]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f063f26-29fa-481a-88c0-16f7d7b76889]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4703752c-5ad5-4878-b319-f04bf4729689]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260]
Oct 20 11:52:01 user nova-compute[74241]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260] successful.
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a832e1-f9a3-4654-937d-0e05080c8627]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] <== disconnect_volume: return (345ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Start _get_guest_xml network_info=[{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51d4a3aa-5eba-4773-bb5c-72300483f2dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '51d4a3aa-5eba-4773-bb5c-72300483f2dd'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '513f5b81-9dce-476f-85db-ebf48fcd0272', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moZdWGMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '5b6ea39f-b167-480f-a288-d9bcf55434d2', 'attached_at': '', 'detached_at': '', 'volume_id': 'acb3a9db-471d-4232-a95c-a21d445912b0', 'serial': 'acb3a9db-471d-4232-a95c-a21d445912b0'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:52:01 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:52:01 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=51d4a3aa-5eba-4773-bb5c-72300483f2dd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.objects.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Object Instance<5b6ea39f-b167-480f-a288-d9bcf55434d2> lazy-loaded attributes: resources,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moZdWGMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:52:01 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:52:01 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:52:01 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1b8cb7-01d4-4d7b-9583-712821e3bd42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:52:01 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c0c35-f794-4363-905a-370fb18e8d1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0] added
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[094229bd-1b2a-4dc9-bd61-073c10b42031]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6672b925-e32f-401f-b9a0-8cfb8f9d8a60]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moZdWGMn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moZdWGMn" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e9857-5b0c-4e8f-b78a-fa0932828c8f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'moZdWGMn'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[678b1f62-a305-4cb6-80db-8a716cbb32be]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d13cc0-43c1-458c-a52d-149f3f4422ea]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a37be26-1343-4765-a1b3-90c9f6ce8c88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260]
Oct 20 11:52:01 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260] successful.
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e7518e-cd8d-41a3-b5db-2db4fd818653]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71970a8-9db5-4a64-9709-e60e3c7e3b52]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:01 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:01 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b504af-b271-4baa-9ac5-f2c0122302b7]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moZdWGMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-58d797a2-c61b-44f5-9df2-40fe90f4f6d9 req-f860b89f-142c-4c64-963d-23af2d26477c service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-58d797a2-c61b-44f5-9df2-40fe90f4f6d9 req-f860b89f-142c-4c64-963d-23af2d26477c service nova] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-58d797a2-c61b-44f5-9df2-40fe90f4f6d9 req-f860b89f-142c-4c64-963d-23af2d26477c service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-58d797a2-c61b-44f5-9df2-40fe90f4f6d9 req-f860b89f-142c-4c64-963d-23af2d26477c service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-58d797a2-c61b-44f5-9df2-40fe90f4f6d9 req-f860b89f-142c-4c64-963d-23af2d26477c service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] No waiting events found dispatching network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:52:02 user nova-compute[74241]: WARNING nova.compute.manager [req-58d797a2-c61b-44f5-9df2-40fe90f4f6d9 req-f860b89f-142c-4c64-963d-23af2d26477c service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received unexpected event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23239333433363434', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239333433363434', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-25201554',display_name='tempest-TestMinimumBasicScenario-server-25201554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-25201554',id=26,image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeMrMy/sg8XxWtYVyzeFxR7apHfoUn94/bg1fXss/Ic+vdCwCyawATmHr7tQMWjdJcw/9i3eMIb4VHHfQtc1ntaLqNp4C9Dkh99q7CMBGUWZcrFycpxkFPQJHKvbN6R7w==',key_name='tempest-TestMinimumBasicScenario-454614026',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-rnf101oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:52:00Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=5b6ea39f-b167-480f-a288-d9bcf55434d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.objects.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Object Instance<5b6ea39f-b167-480f-a288-d9bcf55434d2> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:52:02 user nova-compute[74241]:   <uuid>5b6ea39f-b167-480f-a288-d9bcf55434d2</uuid>
Oct 20 11:52:02 user nova-compute[74241]:   <name>instance-0000001a</name>
Oct 20 11:52:02 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:52:02 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:52:02 user nova-compute[74241]:   <metadata>
Oct 20 11:52:02 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:52:02 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:52:02 user nova-compute[74241]:       <nova:name>tempest-TestMinimumBasicScenario-server-25201554</nova:name>
Oct 20 11:52:02 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:52:01</nova:creationTime>
Oct 20 11:52:02 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:52:02 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:52:02 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:52:02 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:52:02 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:52:02 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:52:02 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:52:02 user nova-compute[74241]:       <nova:owner>
Oct 20 11:52:02 user nova-compute[74241]:         <nova:user uuid="cd2b2cd84c5a403f868d69ccc7f8afc4">tempest-TestMinimumBasicScenario-2068641795-project-member</nova:user>
Oct 20 11:52:02 user nova-compute[74241]:         <nova:project uuid="137870b8216f4a49b1eecde3ec14b75a">tempest-TestMinimumBasicScenario-2068641795</nova:project>
Oct 20 11:52:02 user nova-compute[74241]:       </nova:owner>
Oct 20 11:52:02 user nova-compute[74241]:       <nova:root type="image" uuid="51d4a3aa-5eba-4773-bb5c-72300483f2dd"/>
Oct 20 11:52:02 user nova-compute[74241]:       <nova:ports>
Oct 20 11:52:02 user nova-compute[74241]:         <nova:port uuid="b6096fc9-6928-4d9e-9066-9174bd327ff2">
Oct 20 11:52:02 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 11:52:02 user nova-compute[74241]:         </nova:port>
Oct 20 11:52:02 user nova-compute[74241]:       </nova:ports>
Oct 20 11:52:02 user nova-compute[74241]:     </nova:instance>
Oct 20 11:52:02 user nova-compute[74241]:   </metadata>
Oct 20 11:52:02 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:52:02 user nova-compute[74241]:     <system>
Oct 20 11:52:02 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:52:02 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:52:02 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:52:02 user nova-compute[74241]:       <entry name="serial">5b6ea39f-b167-480f-a288-d9bcf55434d2</entry>
Oct 20 11:52:02 user nova-compute[74241]:       <entry name="uuid">5b6ea39f-b167-480f-a288-d9bcf55434d2</entry>
Oct 20 11:52:02 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:52:02 user nova-compute[74241]:     </system>
Oct 20 11:52:02 user nova-compute[74241]:   </sysinfo>
Oct 20 11:52:02 user nova-compute[74241]:   <os>
Oct 20 11:52:02 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:52:02 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:52:02 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:52:02 user nova-compute[74241]:   </os>
Oct 20 11:52:02 user nova-compute[74241]:   <features>
Oct 20 11:52:02 user nova-compute[74241]:     <acpi/>
Oct 20 11:52:02 user nova-compute[74241]:     <apic/>
Oct 20 11:52:02 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:52:02 user nova-compute[74241]:   </features>
Oct 20 11:52:02 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:52:02 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:52:02 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:52:02 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:52:02 user nova-compute[74241]:   </clock>
Oct 20 11:52:02 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:52:02 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:52:02 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:52:02 user nova-compute[74241]:   </cpu>
Oct 20 11:52:02 user nova-compute[74241]:   <devices>
Oct 20 11:52:02 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:52:02 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:52:02 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk"/>
Oct 20 11:52:02 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:52:02 user nova-compute[74241]:     </disk>
Oct 20 11:52:02 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:52:02 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:52:02 user nova-compute[74241]:       <source dev="/dev/sdc"/>
Oct 20 11:52:02 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:52:02 user nova-compute[74241]:       <serial>acb3a9db-471d-4232-a95c-a21d445912b0</serial>
Oct 20 11:52:02 user nova-compute[74241]:     </disk>
Oct 20 11:52:02 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:52:02 user nova-compute[74241]:       <mac address="fa:16:3e:54:e1:43"/>
Oct 20 11:52:02 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:52:02 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:52:02 user nova-compute[74241]:       <target dev="tapb6096fc9-69"/>
Oct 20 11:52:02 user nova-compute[74241]:     </interface>
Oct 20 11:52:02 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:52:02 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/console.log" append="off"/>
Oct 20 11:52:02 user nova-compute[74241]:     </serial>
Oct 20 11:52:02 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:52:02 user nova-compute[74241]:     <video>
Oct 20 11:52:02 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:52:02 user nova-compute[74241]:     </video>
Oct 20 11:52:02 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:52:02 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:52:02 user nova-compute[74241]:     </rng>
Oct 20 11:52:02 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:52:02 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:52:02 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:52:02 user nova-compute[74241]:     </memballoon>
Oct 20 11:52:02 user nova-compute[74241]:   </devices>
Oct 20 11:52:02 user nova-compute[74241]: </domain>
Oct 20 11:52:02 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:52:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.objects.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Object Instance<5b6ea39f-b167-480f-a288-d9bcf55434d2> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Cannot resize image /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'migration_context' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.objects.base [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Object Instance<5b6ea39f-b167-480f-a288-d9bcf55434d2> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-25201554',display_name='tempest-TestMinimumBasicScenario-server-25201554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-25201554',id=26,image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeMrMy/sg8XxWtYVyzeFxR7apHfoUn94/bg1fXss/Ic+vdCwCyawATmHr7tQMWjdJcw/9i3eMIb4VHHfQtc1ntaLqNp4C9Dkh99q7CMBGUWZcrFycpxkFPQJHKvbN6R7w==',key_name='tempest-TestMinimumBasicScenario-454614026',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-rnf101oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:52:00Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=5b6ea39f-b167-480f-a288-d9bcf55434d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG os_vif [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8208a151-6342-5320-8502-873639436e3d', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6096fc9-69, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6096fc9-69, col_values=(('qos', UUID('513cf096-40ea-4d42-8fc7-5fbbd4a984aa')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6096fc9-69, col_values=(('external_ids', {'iface-id': 'b6096fc9-6928-4d9e-9066-9174bd327ff2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:e1:43', 'vm-uuid': '5b6ea39f-b167-480f-a288-d9bcf55434d2'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:03 user nova-compute[74241]: INFO os_vif [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69')
Oct 20 11:52:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-92da8580-c435-4bde-a72c-d7a3cb272eb1 req-6eb82a58-a72b-4eac-af77-0ba3da4b5547 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-92da8580-c435-4bde-a72c-d7a3cb272eb1 req-6eb82a58-a72b-4eac-af77-0ba3da4b5547 service nova] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-92da8580-c435-4bde-a72c-d7a3cb272eb1 req-6eb82a58-a72b-4eac-af77-0ba3da4b5547 service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-92da8580-c435-4bde-a72c-d7a3cb272eb1 req-6eb82a58-a72b-4eac-af77-0ba3da4b5547 service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-92da8580-c435-4bde-a72c-d7a3cb272eb1 req-6eb82a58-a72b-4eac-af77-0ba3da4b5547 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] No waiting events found dispatching network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:52:07 user nova-compute[74241]: WARNING nova.compute.manager [req-92da8580-c435-4bde-a72c-d7a3cb272eb1 req-6eb82a58-a72b-4eac-af77-0ba3da4b5547 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received unexpected event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-30e30df2-d496-46fe-9bd0-60e18cc2aa6b req-1b640d2e-190c-4aaf-96d9-eb1b5af0de3d service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-30e30df2-d496-46fe-9bd0-60e18cc2aa6b req-1b640d2e-190c-4aaf-96d9-eb1b5af0de3d service nova] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-30e30df2-d496-46fe-9bd0-60e18cc2aa6b req-1b640d2e-190c-4aaf-96d9-eb1b5af0de3d service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-30e30df2-d496-46fe-9bd0-60e18cc2aa6b req-1b640d2e-190c-4aaf-96d9-eb1b5af0de3d service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-30e30df2-d496-46fe-9bd0-60e18cc2aa6b req-1b640d2e-190c-4aaf-96d9-eb1b5af0de3d service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] No waiting events found dispatching network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:52:07 user nova-compute[74241]: WARNING nova.compute.manager [req-30e30df2-d496-46fe-9bd0-60e18cc2aa6b req-1b640d2e-190c-4aaf-96d9-eb1b5af0de3d service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received unexpected event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 for instance with vm_state active and task_state reboot_started_hard.
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQcCJtWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:52:07 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:52:07 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:52:07 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "8e272771-2827-400d-a7f9-d785c158dcf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "8e272771-2827-400d-a7f9-d785c158dcf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:07 user nova-compute[74241]: INFO nova.compute.manager [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Terminating instance
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYCLvKPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:52:07 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:52:07 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Instance rebooted successfully.
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:52:07 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:52:07 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7456MB free_disk=25.22845458984375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[916ffd91-3bd6-4c20-b0b1-51a0e8daac0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:52:07 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d137df0-e750-4fc0-af54-393bb5ace000]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f] added
Oct 20 11:52:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3af3d8-791b-4a42-bee7-983588425f7f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0c5562-7ad9-4358-b9db-9d21ce7b7f07]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0dafc12d-d351-4558-854e-f07b160a32e5 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.235s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQcCJtWD {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AQcCJtWD" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b723383f-67fd-41fb-af1b-d5a9742d03e7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AQcCJtWD'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.047s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c329968-075b-44f1-beaf-91ccb60d3aea]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 743736c6-e1de-4f11-bc3c-09194744e60e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e0723ef5-96db-4191-84da-05eab21e5837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8e272771-2827-400d-a7f9-d785c158dcf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[47089010-bd91-4b93-974e-a2659591df05]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:07 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:07 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c08667a-279c-43e3-9575-33bd0883d1f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f, portal: 172.16.0.220,3260]
Oct 20 11:52:07 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f, portal: 172.16.0.220,3260] successful.
Oct 20 11:52:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e112fe5-d480-47f7-affb-59e5bcb3a431]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77b90b9-19f1-4e78-8b50-1dd470cfa7ad]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:07 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:07 user nova-compute[74241]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)
Oct 20 11:52:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:07 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:07 user nova-compute[74241]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)
Oct 20 11:52:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-5afb46ad-7484-49b3-9a04-8d3650dd90cc req-8e5334c9-556b-4724-8ecd-4c8a3206136a service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received event network-vif-unplugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5afb46ad-7484-49b3-9a04-8d3650dd90cc req-8e5334c9-556b-4724-8ecd-4c8a3206136a service nova] Acquiring lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5afb46ad-7484-49b3-9a04-8d3650dd90cc req-8e5334c9-556b-4724-8ecd-4c8a3206136a service nova] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5afb46ad-7484-49b3-9a04-8d3650dd90cc req-8e5334c9-556b-4724-8ecd-4c8a3206136a service nova] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-5afb46ad-7484-49b3-9a04-8d3650dd90cc req-8e5334c9-556b-4724-8ecd-4c8a3206136a service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] No waiting events found dispatching network-vif-unplugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-5afb46ad-7484-49b3-9a04-8d3650dd90cc req-8e5334c9-556b-4724-8ecd-4c8a3206136a service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received event network-vif-unplugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d58cab-7ac4-4291-998c-074fb1b7558d]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:52:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQcCJtWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Instance destroyed successfully.
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lazy-loading 'resources' on Instance uuid 8e272771-2827-400d-a7f9-d785c158dcf3 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1349886952',display_name='tempest-VolumesActionsTest-instance-1349886952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1349886952',id=30,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:50:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='191f0dcc776c4b39854429de2da2f6b6',ramdisk_id='',reservation_id='r-zl8y6mq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-742523305',owner_user_name='tempest-VolumesActionsTest-742523305-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:50:20Z,user_data=None,user_id='ff4914c45f8d42769609be5b8efac117',uuid=8e272771-2827-400d-a7f9-d785c158dcf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converting VIF {"id": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "address": "fa:16:3e:e1:14:6f", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6f1a42c-92", "ovs_interfaceid": "c6f1a42c-92a2-49f0-a3f6-77904c10bec4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:14:6f,bridge_name='br-int',has_traffic_filtering=True,id=c6f1a42c-92a2-49f0-a3f6-77904c10bec4,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1a42c-92') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_vif [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:14:6f,bridge_name='br-int',has_traffic_filtering=True,id=c6f1a42c-92a2-49f0-a3f6-77904c10bec4,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1a42c-92') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6f1a42c-92, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e6a1ba5-4156-428c-ac95-531a18a2a870) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:08 user nova-compute[74241]: INFO os_vif [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:14:6f,bridge_name='br-int',has_traffic_filtering=True,id=c6f1a42c-92a2-49f0-a3f6-77904c10bec4,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6f1a42c-92')
Oct 20 11:52:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Deleting instance files /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3_del
Oct 20 11:52:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Deletion of /opt/stack/data/nova/instances/8e272771-2827-400d-a7f9-d785c158dcf3_del complete
Oct 20 11:52:08 user nova-compute[74241]: INFO nova.compute.manager [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23263306361643131', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263306361643131', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.383s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:52:08 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:52:08 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 743736c6-e1de-4f11-bc3c-09194744e60e {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[12497098-ebc6-4259-a662-fa416e72c25c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:52:08 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:52:08 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:52:08 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:52:08 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:52:08 user nova-compute[74241]:   <serial>ab385904-c116-4262-8c48-101b06b8de4f</serial>
Oct 20 11:52:08 user nova-compute[74241]: </disk>
Oct 20 11:52:08 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f02ce5c-ce59-4503-aa1a-d1fd1a24280c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711] added
Oct 20 11:52:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb851a3-cfa4-4a01-8025-0cb2620aed5e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:08 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Took 0.57 seconds to deallocate network for instance.
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b108a6-988b-46d8-b016-fad3c98d53ee]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sYCLvKPt {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sYCLvKPt" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da88e74-a5b4-405d-aa00-a4441d9c18cd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sYCLvKPt'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dac551-d999-41d6-82a9-08a42a2f1aae]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[606cec2b-56d9-4629-b96d-d703f7c7887b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)
Oct 20 11:52:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)
Oct 20 11:52:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[356c081e-87ae-424d-9080-163ce7a16a69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711, portal: 172.16.0.220,3260]
Oct 20 11:52:09 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711, portal: 172.16.0.220,3260] successful.
Oct 20 11:52:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c454ce-1e52-4d62-87c9-c3469517f1dc]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a608dff-243f-4ac2-85a8-cf1f5d36f48b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:52:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)
Oct 20 11:52:09 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:52:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dab416-60b1-451e-a51c-54759607d190]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYCLvKPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] No VIF found with MAC fa:16:3e:3d:fe:a2, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.419s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:09 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Deleted allocations for instance 8e272771-2827-400d-a7f9-d785c158dcf3
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7286650e-1d57-4fc2-952c-39d07f77b372 tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.455s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d88d30b0-6d21-4179-9e3f-baba875b6e01 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "8e272771-2827-400d-a7f9-d785c158dcf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.097s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating instance_info_cache with network_info: [{"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-333dae7f-9914-4604-a36b-8e5d4d2a4bce" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-a54b5349-234a-41c5-9995-43c42a13269a req-3cbb381d-4fb8-4fe5-aad1-b2c7eeb5fd9c service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received event network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a54b5349-234a-41c5-9995-43c42a13269a req-3cbb381d-4fb8-4fe5-aad1-b2c7eeb5fd9c service nova] Acquiring lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a54b5349-234a-41c5-9995-43c42a13269a req-3cbb381d-4fb8-4fe5-aad1-b2c7eeb5fd9c service nova] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a54b5349-234a-41c5-9995-43c42a13269a req-3cbb381d-4fb8-4fe5-aad1-b2c7eeb5fd9c service nova] Lock "8e272771-2827-400d-a7f9-d785c158dcf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-a54b5349-234a-41c5-9995-43c42a13269a req-3cbb381d-4fb8-4fe5-aad1-b2c7eeb5fd9c service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] No waiting events found dispatching network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:52:09 user nova-compute[74241]: WARNING nova.compute.manager [req-a54b5349-234a-41c5-9995-43c42a13269a req-3cbb381d-4fb8-4fe5-aad1-b2c7eeb5fd9c service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received unexpected event network-vif-plugged-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 for instance with vm_state deleted and task_state None.
Oct 20 11:52:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-a54b5349-234a-41c5-9995-43c42a13269a req-3cbb381d-4fb8-4fe5-aad1-b2c7eeb5fd9c service nova] [instance: 8e272771-2827-400d-a7f9-d785c158dcf3] Received event network-vif-deleted-c6f1a42c-92a2-49f0-a3f6-77904c10bec4 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] <== connect_volume: return (2736ms) {'type': 'block', 'scsi_wwn': '26661663466653664', 'path': '/dev/sde'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661663466653664', 'path': '/dev/sde'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.objects.instance [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'flavor' on Instance uuid e0723ef5-96db-4191-84da-05eab21e5837 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:52:10 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:52:10 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:52:10 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:52:10 user nova-compute[74241]:   <serial>da9ea5e2-01dd-4e42-a98f-ba347f5f3711</serial>
Oct 20 11:52:10 user nova-compute[74241]: </disk>
Oct 20 11:52:10 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No VIF found with MAC fa:16:3e:fc:76:9b, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:10 user nova-compute[74241]: INFO nova.compute.manager [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Detaching volume ab385904-c116-4262-8c48-101b06b8de4f
Oct 20 11:52:10 user nova-compute[74241]: INFO nova.virt.block_device [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Attempting to driver detach volume ab385904-c116-4262-8c48-101b06b8de4f from mountpoint /dev/vdb
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Attempting to detach device vdb from instance 743736c6-e1de-4f11-bc3c-09194744e60e from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:52:10 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:52:10 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:52:10 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:52:10 user nova-compute[74241]:   <serial>ab385904-c116-4262-8c48-101b06b8de4f</serial>
Oct 20 11:52:10 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:52:10 user nova-compute[74241]: </disk>
Oct 20 11:52:10 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1787ad9c-f823-4cf8-82f5-9f946d20bd18 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 37.489s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully detached device vdb from instance 743736c6-e1de-4f11-bc3c-09194744e60e from the persistent domain config.
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 743736c6-e1de-4f11-bc3c-09194744e60e from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:52:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:52:10 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:52:10 user nova-compute[74241]:   <source dev="/dev/sdd"/>
Oct 20 11:52:10 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:52:10 user nova-compute[74241]:   <serial>ab385904-c116-4262-8c48-101b06b8de4f</serial>
Oct 20 11:52:10 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:52:10 user nova-compute[74241]: </disk>
Oct 20 11:52:10 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:52:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 743736c6-e1de-4f11-bc3c-09194744e60e {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:52:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:13 user nova-compute[74241]: INFO nova.compute.manager [None req-ae9a8c28-318c-4d99-a9dc-642a5c128eaf tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Get console output
Oct 20 11:52:13 user nova-compute[74241]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:16 user nova-compute[74241]: INFO nova.compute.manager [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Terminating instance
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-4bdd0106-4937-41de-aa9c-1832a60d33a3 req-b22af676-6b7f-4a66-bdcb-3e82d6566cd7 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4bdd0106-4937-41de-aa9c-1832a60d33a3 req-b22af676-6b7f-4a66-bdcb-3e82d6566cd7 service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4bdd0106-4937-41de-aa9c-1832a60d33a3 req-b22af676-6b7f-4a66-bdcb-3e82d6566cd7 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4bdd0106-4937-41de-aa9c-1832a60d33a3 req-b22af676-6b7f-4a66-bdcb-3e82d6566cd7 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-4bdd0106-4937-41de-aa9c-1832a60d33a3 req-b22af676-6b7f-4a66-bdcb-3e82d6566cd7 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-4bdd0106-4937-41de-aa9c-1832a60d33a3 req-b22af676-6b7f-4a66-bdcb-3e82d6566cd7 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-unplugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:52:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Instance destroyed successfully.
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'resources' on Instance uuid 333dae7f-9914-4604-a36b-8e5d4d2a4bce {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1214393435',display_name='tempest-AttachVolumeTestJSON-server-1214393435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1214393435',id=19,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSXDS2XeKsSqXsusKmD2LeDn3s0jSWQiL2mHjD8oMNU1Q+mZrDNxeYjBNqbY5MeT4JKdaMMc3XcyH+9fb6+A3jGTJusU7RLymeE7jwq4M7Q1OtulWfcZVIlmVr18w61jQ==',key_name='tempest-keypair-42476405',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-7k6f0fyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=333dae7f-9914-4604-a36b-8e5d4d2a4bce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "d970e2bd-a050-4038-afec-cb86392153c9", "address": "fa:16:3e:4d:4b:43", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd970e2bd-a0", "ovs_interfaceid": "d970e2bd-a050-4038-afec-cb86392153c9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG os_vif [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd970e2bd-a0, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad8cdf0b-fc35-4840-95ab-bb183abb6562) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:16 user nova-compute[74241]: INFO os_vif [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:4b:43,bridge_name='br-int',has_traffic_filtering=True,id=d970e2bd-a050-4038-afec-cb86392153c9,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd970e2bd-a0')
Oct 20 11:52:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Deleting instance files /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce_del
Oct 20 11:52:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Deletion of /opt/stack/data/nova/instances/333dae7f-9914-4604-a36b-8e5d4d2a4bce_del complete
Oct 20 11:52:16 user nova-compute[74241]: INFO nova.compute.manager [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 20 11:52:16 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:52:16 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:52:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:17 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:17 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Took 0.85 seconds to deallocate network for instance.
Oct 20 11:52:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:18 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:52:18 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:52:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:18 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Deleted allocations for instance 333dae7f-9914-4604-a36b-8e5d4d2a4bce
Oct 20 11:52:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4d39aa17-98e1-401f-9075-d77308dc8aa8 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.076s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-29ecaddc-ec86-4600-9ead-1a312f174087 req-e28e8a7a-ec82-4e3c-addd-7df3425ec650 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-29ecaddc-ec86-4600-9ead-1a312f174087 req-e28e8a7a-ec82-4e3c-addd-7df3425ec650 service nova] Acquiring lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-29ecaddc-ec86-4600-9ead-1a312f174087 req-e28e8a7a-ec82-4e3c-addd-7df3425ec650 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-29ecaddc-ec86-4600-9ead-1a312f174087 req-e28e8a7a-ec82-4e3c-addd-7df3425ec650 service nova] Lock "333dae7f-9914-4604-a36b-8e5d4d2a4bce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-29ecaddc-ec86-4600-9ead-1a312f174087 req-e28e8a7a-ec82-4e3c-addd-7df3425ec650 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] No waiting events found dispatching network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:52:18 user nova-compute[74241]: WARNING nova.compute.manager [req-29ecaddc-ec86-4600-9ead-1a312f174087 req-e28e8a7a-ec82-4e3c-addd-7df3425ec650 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received unexpected event network-vif-plugged-d970e2bd-a050-4038-afec-cb86392153c9 for instance with vm_state deleted and task_state None.
Oct 20 11:52:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-29ecaddc-ec86-4600-9ead-1a312f174087 req-e28e8a7a-ec82-4e3c-addd-7df3425ec650 service nova] [instance: 333dae7f-9914-4604-a36b-8e5d4d2a4bce] Received event network-vif-deleted-d970e2bd-a050-4038-afec-cb86392153c9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:31 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 743736c6-e1de-4f11-bc3c-09194744e60e is timed out.
Oct 20 11:52:31 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully detached device vdb from instance 743736c6-e1de-4f11-bc3c-09194744e60e from the live domain config.
Oct 20 11:52:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AQcCJtWD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:52:31 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f54765-35e8-4053-a66f-8e907c8e9ba1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:52:31 user nova-compute[74241]: No targets found.
Oct 20 11:52:31 user nova-compute[74241]: iSNS:
Oct 20 11:52:31 user nova-compute[74241]: No targets found.
Oct 20 11:52:31 user nova-compute[74241]: STATIC:
Oct 20 11:52:31 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0
Oct 20 11:52:31 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:52:31 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:52:31 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f
Oct 20 11:52:31 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:52:31 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:52:31 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a
Oct 20 11:52:31 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:52:31 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:52:31 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711
Oct 20 11:52:31 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:52:31 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:52:31 user nova-compute[74241]: FIRMWARE:
Oct 20 11:52:31 user nova-compute[74241]: No targets found.
Oct 20 11:52:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:52:31 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:52:31 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[789c9a1b-7f92-4910-8b04-4458a1d431a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb06dfd9-9227-403e-825a-e0c6a014615f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:31 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:31 user nova-compute[74241]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)
Oct 20 11:52:31 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:52:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:52:31 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:52:31 user nova-compute[74241]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f (non-flash)
Oct 20 11:52:31 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:52:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f520861ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f'): ({'sdd'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Removing single pathed devices sdd {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[81454756-7c74-4257-bc3b-5c8503081511]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[724a6000-64e5-4e1f-ad73-ff9ceefeb436]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Flushing IO for device /dev/sdd {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[948a6747-31bb-4d06-aa46-a4d14291b1a0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c2ecc7-f752-4578-b3a2-1bf135336212]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13471c2-430c-4b27-9293-bebedfd99b1d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f61382e-d4ad-4357-91cd-d53cb514507c]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f, portal: 172.16.0.220,3260]
Oct 20 11:52:31 user nova-compute[74241]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f, portal: 172.16.0.220,3260] successful.
Oct 20 11:52:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab385904-c116-4262-8c48-101b06b8de4f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e59f04-0198-453f-a510-36cc889b3a1e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] <== disconnect_volume: return (318ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:52:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:32 user nova-compute[74241]: DEBUG nova.objects.instance [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'flavor' on Instance uuid 743736c6-e1de-4f11-bc3c-09194744e60e {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1f8c863b-7019-4508-87da-b23bada21d5e tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.751s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:52:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:41 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:52:41 user nova-compute[74241]: INFO nova.compute.claims [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Claim successful on node user
Oct 20 11:52:42 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:52:42 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:52:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:52:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:52:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:52:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:52:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:52:42 user nova-compute[74241]: DEBUG nova.policy [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c611c28a9264820a26f203045040420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f8151a0cf44b2d89838da474c2dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:52:42 user nova-compute[74241]: INFO nova.virt.block_device [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Booting with blank volume at /dev/vda
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Successfully created port: 8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-b02a6c5c-fa20-43df-8780-badb0de36f12 req-b4973972-e370-4609-8d9d-7936d1ab0b22 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-changed-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-b02a6c5c-fa20-43df-8780-badb0de36f12 req-b4973972-e370-4609-8d9d-7936d1ab0b22 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Refreshing instance network info cache due to event network-changed-d7f9f66f-674b-41d6-9460-5f0be423b6d1. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b02a6c5c-fa20-43df-8780-badb0de36f12 req-b4973972-e370-4609-8d9d-7936d1ab0b22 service nova] Acquiring lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b02a6c5c-fa20-43df-8780-badb0de36f12 req-b4973972-e370-4609-8d9d-7936d1ab0b22 service nova] Acquired lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-b02a6c5c-fa20-43df-8780-badb0de36f12 req-b4973972-e370-4609-8d9d-7936d1ab0b22 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Refreshing network info cache for port d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Successfully updated port: 8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquired lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-d00d75b8-1988-44bb-963e-a44e3fc2df39 req-d5a49d59-4bc0-454f-b6d8-2e5eff07c6f4 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-changed-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-d00d75b8-1988-44bb-963e-a44e3fc2df39 req-d5a49d59-4bc0-454f-b6d8-2e5eff07c6f4 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Refreshing instance network info cache due to event network-changed-8cd19fc4-d5a2-429e-a495-de7e92ccb893. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d00d75b8-1988-44bb-963e-a44e3fc2df39 req-d5a49d59-4bc0-454f-b6d8-2e5eff07c6f4 service nova] Acquiring lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG nova.objects.instance [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'flavor' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:44 user nova-compute[74241]: INFO nova.compute.manager [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Attaching volume b1fd0cc6-8526-49ac-8f16-da9747940bfa to /dev/vdb
Oct 20 11:52:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-b02a6c5c-fa20-43df-8780-badb0de36f12 req-b4973972-e370-4609-8d9d-7936d1ab0b22 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updated VIF entry in instance network info cache for port d7f9f66f-674b-41d6-9460-5f0be423b6d1. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-b02a6c5c-fa20-43df-8780-badb0de36f12 req-b4973972-e370-4609-8d9d-7936d1ab0b22 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b02a6c5c-fa20-43df-8780-badb0de36f12 req-b4973972-e370-4609-8d9d-7936d1ab0b22 service nova] Releasing lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG os_brick.utils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating instance_info_cache with network_info: [{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b9be3-ebcf-40b8-85f9-901bc9aec793]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Releasing lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance network_info: |[{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d00d75b8-1988-44bb-963e-a44e3fc2df39 req-d5a49d59-4bc0-454f-b6d8-2e5eff07c6f4 service nova] Acquired lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-d00d75b8-1988-44bb-963e-a44e3fc2df39 req-d5a49d59-4bc0-454f-b6d8-2e5eff07c6f4 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Refreshing network info cache for port 8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d612c0-a075-4644-81aa-6d3d2904898d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b491e6-4aa2-4f17-91fd-43c056a411ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac56d634-ce05-449d-9cc8-10bf37b2427e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:52:44 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[73278d02-1477-4c6a-ad7e-5a3b63ac2028]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG os_brick.utils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating existing volume attachment record: afb7e32e-a26d-47ad-96b2-0dcf377fa022 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-d00d75b8-1988-44bb-963e-a44e3fc2df39 req-d5a49d59-4bc0-454f-b6d8-2e5eff07c6f4 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updated VIF entry in instance network info cache for port 8cd19fc4-d5a2-429e-a495-de7e92ccb893. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-d00d75b8-1988-44bb-963e-a44e3fc2df39 req-d5a49d59-4bc0-454f-b6d8-2e5eff07c6f4 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating instance_info_cache with network_info: [{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d00d75b8-1988-44bb-963e-a44e3fc2df39 req-d5a49d59-4bc0-454f-b6d8-2e5eff07c6f4 service nova] Releasing lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:52:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:52:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG os_brick.utils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2228c27-62cf-4cd1-8bce-6f5e23055f1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b0014f-0c49-41bb-accc-913d35080d77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c56cb9-5c87-4b52-b7ab-fc519c4d4695]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93f5b99-8e82-4f57-9235-933c4bfbf809]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:52:48 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:52:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1172fb6-b991-458a-bbd3-1fa42a588efc]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG os_brick.utils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:52:48 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating existing volume attachment record: 5d9b0b05-88c8-48d0-a760-f2166c366b0c {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:52:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "d24bf60b-6e03-4708-a615-1a2b42869cfe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:52:56 user nova-compute[74241]: INFO nova.compute.claims [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Claim successful on node user
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:52:56 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.policy [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4914c45f8d42769609be5b8efac117', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '191f0dcc776c4b39854429de2da2f6b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:52:56 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Creating image(s)
Oct 20 11:52:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "/opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "/opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "/opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk 1073741824" returned: 0 in 0.054s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Successfully created port: 181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Cannot resize image /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Ensure instance console log exists: /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:52:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Successfully updated port: 181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "refresh_cache-d24bf60b-6e03-4708-a615-1a2b42869cfe" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquired lock "refresh_cache-d24bf60b-6e03-4708-a615-1a2b42869cfe" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-057be69d-cc7b-406e-81c3-31964d8e12fa req-eacad450-9cc3-4491-874d-7da4d0b52e1b service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received event network-changed-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-057be69d-cc7b-406e-81c3-31964d8e12fa req-eacad450-9cc3-4491-874d-7da4d0b52e1b service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Refreshing instance network info cache due to event network-changed-181cea76-6b32-4a31-be53-657815fcaf95. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-057be69d-cc7b-406e-81c3-31964d8e12fa req-eacad450-9cc3-4491-874d-7da4d0b52e1b service nova] Acquiring lock "refresh_cache-d24bf60b-6e03-4708-a615-1a2b42869cfe" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Updating instance_info_cache with network_info: [{"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Releasing lock "refresh_cache-d24bf60b-6e03-4708-a615-1a2b42869cfe" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Instance network_info: |[{"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-057be69d-cc7b-406e-81c3-31964d8e12fa req-eacad450-9cc3-4491-874d-7da4d0b52e1b service nova] Acquired lock "refresh_cache-d24bf60b-6e03-4708-a615-1a2b42869cfe" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.neutron [req-057be69d-cc7b-406e-81c3-31964d8e12fa req-eacad450-9cc3-4491-874d-7da4d0b52e1b service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Refreshing network info cache for port 181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Start _get_guest_xml network_info=[{"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:52:58 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:52:58 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1591118686',display_name='tempest-VolumesActionsTest-instance-1591118686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1591118686',id=33,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191f0dcc776c4b39854429de2da2f6b6',ramdisk_id='',reservation_id='r-299h0d98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-742523305',owner_user_name='tempest-VolumesActionsTest-742523305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:52:57Z,user_data=None,user_id='ff4914c45f8d42769609be5b8efac117',uuid=d24bf60b-6e03-4708-a615-1a2b42869cfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converting VIF {"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:cd,bridge_name='br-int',has_traffic_filtering=True,id=181cea76-6b32-4a31-be53-657815fcaf95,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181cea76-6b') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lazy-loading 'pci_devices' on Instance uuid d24bf60b-6e03-4708-a615-1a2b42869cfe {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:52:58 user nova-compute[74241]:   <uuid>d24bf60b-6e03-4708-a615-1a2b42869cfe</uuid>
Oct 20 11:52:58 user nova-compute[74241]:   <name>instance-00000021</name>
Oct 20 11:52:58 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:52:58 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:52:58 user nova-compute[74241]:   <metadata>
Oct 20 11:52:58 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:52:58 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:52:58 user nova-compute[74241]:       <nova:name>tempest-VolumesActionsTest-instance-1591118686</nova:name>
Oct 20 11:52:58 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:52:58</nova:creationTime>
Oct 20 11:52:58 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:52:58 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:52:58 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:52:58 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:52:58 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:52:58 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:52:58 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:52:58 user nova-compute[74241]:       <nova:owner>
Oct 20 11:52:58 user nova-compute[74241]:         <nova:user uuid="ff4914c45f8d42769609be5b8efac117">tempest-VolumesActionsTest-742523305-project-member</nova:user>
Oct 20 11:52:58 user nova-compute[74241]:         <nova:project uuid="191f0dcc776c4b39854429de2da2f6b6">tempest-VolumesActionsTest-742523305</nova:project>
Oct 20 11:52:58 user nova-compute[74241]:       </nova:owner>
Oct 20 11:52:58 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:52:58 user nova-compute[74241]:       <nova:ports>
Oct 20 11:52:58 user nova-compute[74241]:         <nova:port uuid="181cea76-6b32-4a31-be53-657815fcaf95">
Oct 20 11:52:58 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 11:52:58 user nova-compute[74241]:         </nova:port>
Oct 20 11:52:58 user nova-compute[74241]:       </nova:ports>
Oct 20 11:52:58 user nova-compute[74241]:     </nova:instance>
Oct 20 11:52:58 user nova-compute[74241]:   </metadata>
Oct 20 11:52:58 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:52:58 user nova-compute[74241]:     <system>
Oct 20 11:52:58 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:52:58 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:52:58 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:52:58 user nova-compute[74241]:       <entry name="serial">d24bf60b-6e03-4708-a615-1a2b42869cfe</entry>
Oct 20 11:52:58 user nova-compute[74241]:       <entry name="uuid">d24bf60b-6e03-4708-a615-1a2b42869cfe</entry>
Oct 20 11:52:58 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:52:58 user nova-compute[74241]:     </system>
Oct 20 11:52:58 user nova-compute[74241]:   </sysinfo>
Oct 20 11:52:58 user nova-compute[74241]:   <os>
Oct 20 11:52:58 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:52:58 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:52:58 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:52:58 user nova-compute[74241]:   </os>
Oct 20 11:52:58 user nova-compute[74241]:   <features>
Oct 20 11:52:58 user nova-compute[74241]:     <acpi/>
Oct 20 11:52:58 user nova-compute[74241]:     <apic/>
Oct 20 11:52:58 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:52:58 user nova-compute[74241]:   </features>
Oct 20 11:52:58 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:52:58 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:52:58 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:52:58 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:52:58 user nova-compute[74241]:   </clock>
Oct 20 11:52:58 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:52:58 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:52:58 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:52:58 user nova-compute[74241]:   </cpu>
Oct 20 11:52:58 user nova-compute[74241]:   <devices>
Oct 20 11:52:58 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:52:58 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:52:58 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk"/>
Oct 20 11:52:58 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:52:58 user nova-compute[74241]:     </disk>
Oct 20 11:52:58 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:52:58 user nova-compute[74241]:       <mac address="fa:16:3e:8f:ea:cd"/>
Oct 20 11:52:58 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:52:58 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:52:58 user nova-compute[74241]:       <target dev="tap181cea76-6b"/>
Oct 20 11:52:58 user nova-compute[74241]:     </interface>
Oct 20 11:52:58 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:52:58 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/console.log" append="off"/>
Oct 20 11:52:58 user nova-compute[74241]:     </serial>
Oct 20 11:52:58 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:52:58 user nova-compute[74241]:     <video>
Oct 20 11:52:58 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:52:58 user nova-compute[74241]:     </video>
Oct 20 11:52:58 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:52:58 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:52:58 user nova-compute[74241]:     </rng>
Oct 20 11:52:58 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:52:58 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:52:58 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:52:58 user nova-compute[74241]:     </memballoon>
Oct 20 11:52:58 user nova-compute[74241]:   </devices>
Oct 20 11:52:58 user nova-compute[74241]: </domain>
Oct 20 11:52:58 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1591118686',display_name='tempest-VolumesActionsTest-instance-1591118686',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1591118686',id=33,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='191f0dcc776c4b39854429de2da2f6b6',ramdisk_id='',reservation_id='r-299h0d98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-742523305',owner_user_name='tempest-VolumesActionsTest-742523305-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:52:57Z,user_data=None,user_id='ff4914c45f8d42769609be5b8efac117',uuid=d24bf60b-6e03-4708-a615-1a2b42869cfe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converting VIF {"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:cd,bridge_name='br-int',has_traffic_filtering=True,id=181cea76-6b32-4a31-be53-657815fcaf95,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181cea76-6b') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG os_vif [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:cd,bridge_name='br-int',has_traffic_filtering=True,id=181cea76-6b32-4a31-be53-657815fcaf95,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181cea76-6b') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d69b214-66ab-5eb1-ae82-42c4e22f2d4b', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap181cea76-6b, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap181cea76-6b, col_values=(('qos', UUID('9cd79d3f-3449-4906-bf72-910b100fc251')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap181cea76-6b, col_values=(('external_ids', {'iface-id': '181cea76-6b32-4a31-be53-657815fcaf95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:ea:cd', 'vm-uuid': 'd24bf60b-6e03-4708-a615-1a2b42869cfe'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:58 user nova-compute[74241]: INFO os_vif [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:cd,bridge_name='br-int',has_traffic_filtering=True,id=181cea76-6b32-4a31-be53-657815fcaf95,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181cea76-6b')
Oct 20 11:52:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] No VIF found with MAC fa:16:3e:8f:ea:cd, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.neutron [req-057be69d-cc7b-406e-81c3-31964d8e12fa req-eacad450-9cc3-4491-874d-7da4d0b52e1b service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Updated VIF entry in instance network info cache for port 181cea76-6b32-4a31-be53-657815fcaf95. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG nova.network.neutron [req-057be69d-cc7b-406e-81c3-31964d8e12fa req-eacad450-9cc3-4491-874d-7da4d0b52e1b service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Updating instance_info_cache with network_info: [{"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:52:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-057be69d-cc7b-406e-81c3-31964d8e12fa req-eacad450-9cc3-4491-874d-7da4d0b52e1b service nova] Releasing lock "refresh_cache-d24bf60b-6e03-4708-a615-1a2b42869cfe" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:52:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:52:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-31e89a03-7faa-43d7-b779-529dfbb6f6b9 req-0d61e2cc-ea08-4960-a985-16b52c5b90f9 service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received event network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-31e89a03-7faa-43d7-b779-529dfbb6f6b9 req-0d61e2cc-ea08-4960-a985-16b52c5b90f9 service nova] Acquiring lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-31e89a03-7faa-43d7-b779-529dfbb6f6b9 req-0d61e2cc-ea08-4960-a985-16b52c5b90f9 service nova] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-31e89a03-7faa-43d7-b779-529dfbb6f6b9 req-0d61e2cc-ea08-4960-a985-16b52c5b90f9 service nova] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-31e89a03-7faa-43d7-b779-529dfbb6f6b9 req-0d61e2cc-ea08-4960-a985-16b52c5b90f9 service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] No waiting events found dispatching network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:00 user nova-compute[74241]: WARNING nova.compute.manager [req-31e89a03-7faa-43d7-b779-529dfbb6f6b9 req-0d61e2cc-ea08-4960-a985-16b52c5b90f9 service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received unexpected event network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 for instance with vm_state building and task_state spawning.
Oct 20 11:53:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:01 user nova-compute[74241]: INFO nova.compute.manager [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Terminating instance
Oct 20 11:53:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-4eba6920-1765-43fe-9ff8-25a6c3db9006 req-4ab9b568-ce06-467c-bd99-ac8b2e99c55e service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received event network-vif-unplugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4eba6920-1765-43fe-9ff8-25a6c3db9006 req-4ab9b568-ce06-467c-bd99-ac8b2e99c55e service nova] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4eba6920-1765-43fe-9ff8-25a6c3db9006 req-4ab9b568-ce06-467c-bd99-ac8b2e99c55e service nova] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4eba6920-1765-43fe-9ff8-25a6c3db9006 req-4ab9b568-ce06-467c-bd99-ac8b2e99c55e service nova] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-4eba6920-1765-43fe-9ff8-25a6c3db9006 req-4ab9b568-ce06-467c-bd99-ac8b2e99c55e service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] No waiting events found dispatching network-vif-unplugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-4eba6920-1765-43fe-9ff8-25a6c3db9006 req-4ab9b568-ce06-467c-bd99-ac8b2e99c55e service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received event network-vif-unplugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Instance destroyed successfully.
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lazy-loading 'resources' on Instance uuid 743736c6-e1de-4f11-bc3c-09194744e60e {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1255891937',display_name='tempest-AttachVolumeNegativeTest-server-1255891937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1255891937',id=27,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQJequjGBUORVeDPJjWyOHId0pzB6eqO993QVx759T50cBeqPFybjk5P2Jrm3hwQtdAecgWNk2g0uzMLe87NmWKtKMoPRghJ0LGz6Yai2zaBXwKWxeWZFFsDDyTMafsOw==',key_name='tempest-keypair-34916076',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:49:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ce95d8752f04f25a15f0673b063d405',ramdisk_id='',reservation_id='r-6kv6zr3r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-252317716',owner_user_name='tempest-AttachVolumeNegativeTest-252317716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:49:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3637bc89e77c475ba2fc72002d61b5c2',uuid=743736c6-e1de-4f11-bc3c-09194744e60e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converting VIF {"id": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "1b03693b-6262-4ace-8d41-d549ca1ab948", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-993118128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ce95d8752f04f25a15f0673b063d405", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap135ab84c-fb", "ovs_interfaceid": "135ab84c-fb70-47b9-a4ff-1d29c9f61018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=135ab84c-fb70-47b9-a4ff-1d29c9f61018,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ab84c-fb') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG os_vif [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=135ab84c-fb70-47b9-a4ff-1d29c9f61018,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ab84c-fb') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap135ab84c-fb, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=631fec5c-4b50-4c37-a6d8-dcbfba38082f) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:02 user nova-compute[74241]: INFO os_vif [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=135ab84c-fb70-47b9-a4ff-1d29c9f61018,network=Network(1b03693b-6262-4ace-8d41-d549ca1ab948),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap135ab84c-fb')
Oct 20 11:53:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Deleting instance files /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e_del
Oct 20 11:53:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Deletion of /opt/stack/data/nova/instances/743736c6-e1de-4f11-bc3c-09194744e60e_del complete
Oct 20 11:53:02 user nova-compute[74241]: INFO nova.compute.manager [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Instance spawned successfully.
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-a9a8e246-3e0f-4868-924f-944b5670ad20 req-3e10ee59-2e26-49e9-9af2-88b390243acd service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received event network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a9a8e246-3e0f-4868-924f-944b5670ad20 req-3e10ee59-2e26-49e9-9af2-88b390243acd service nova] Acquiring lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a9a8e246-3e0f-4868-924f-944b5670ad20 req-3e10ee59-2e26-49e9-9af2-88b390243acd service nova] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a9a8e246-3e0f-4868-924f-944b5670ad20 req-3e10ee59-2e26-49e9-9af2-88b390243acd service nova] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-a9a8e246-3e0f-4868-924f-944b5670ad20 req-3e10ee59-2e26-49e9-9af2-88b390243acd service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] No waiting events found dispatching network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:02 user nova-compute[74241]: WARNING nova.compute.manager [req-a9a8e246-3e0f-4868-924f-944b5670ad20 req-3e10ee59-2e26-49e9-9af2-88b390243acd service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received unexpected event network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 for instance with vm_state building and task_state spawning.
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:02 user nova-compute[74241]: INFO nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Took 5.68 seconds to spawn the instance on the hypervisor.
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:02 user nova-compute[74241]: INFO nova.compute.manager [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Took 6.59 seconds to build instance.
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a3793528-30ac-4ef0-9fe6-90312d544cf6 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.703s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:02 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid '743736c6-e1de-4f11-bc3c-09194744e60e' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid '743736c6-e1de-4f11-bc3c-09194744e60e' (instance-0000001b)
Oct 20 11:53:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:03 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Took 0.97 seconds to deallocate network for instance.
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-fffb8f76-c36d-4ebe-a2d8-79d37d097799 req-45d1da50-1a5f-459d-a635-dfb557de023f service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received event network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fffb8f76-c36d-4ebe-a2d8-79d37d097799 req-45d1da50-1a5f-459d-a635-dfb557de023f service nova] Acquiring lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fffb8f76-c36d-4ebe-a2d8-79d37d097799 req-45d1da50-1a5f-459d-a635-dfb557de023f service nova] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fffb8f76-c36d-4ebe-a2d8-79d37d097799 req-45d1da50-1a5f-459d-a635-dfb557de023f service nova] Lock "743736c6-e1de-4f11-bc3c-09194744e60e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-fffb8f76-c36d-4ebe-a2d8-79d37d097799 req-45d1da50-1a5f-459d-a635-dfb557de023f service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] No waiting events found dispatching network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:03 user nova-compute[74241]: WARNING nova.compute.manager [req-fffb8f76-c36d-4ebe-a2d8-79d37d097799 req-45d1da50-1a5f-459d-a635-dfb557de023f service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received unexpected event network-vif-plugged-135ab84c-fb70-47b9-a4ff-1d29c9f61018 for instance with vm_state deleted and task_state None.
Oct 20 11:53:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-fffb8f76-c36d-4ebe-a2d8-79d37d097799 req-45d1da50-1a5f-459d-a635-dfb557de023f service nova] [instance: 743736c6-e1de-4f11-bc3c-09194744e60e] Received event network-vif-deleted-135ab84c-fb70-47b9-a4ff-1d29c9f61018 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.616s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:04 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Deleted allocations for instance 743736c6-e1de-4f11-bc3c-09194744e60e
Oct 20 11:53:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-80d434ef-987c-464f-935a-ce54e8fa961b tempest-AttachVolumeNegativeTest-252317716 tempest-AttachVolumeNegativeTest-252317716-project-member] Lock "743736c6-e1de-4f11-bc3c-09194744e60e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:53:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:53:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:53:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7730MB free_disk=25.272510528564453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e0723ef5-96db-4191-84da-05eab21e5837 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d24bf60b-6e03-4708-a615-1a2b42869cfe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:53:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:53:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:53:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:06 user nova-compute[74241]: INFO nova.compute.manager [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Detaching volume da9ea5e2-01dd-4e42-a98f-ba347f5f3711
Oct 20 11:53:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:53:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:53:06 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:53:06 user nova-compute[74241]: INFO nova.virt.block_device [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Attempting to driver detach volume da9ea5e2-01dd-4e42-a98f-ba347f5f3711 from mountpoint /dev/vdb
Oct 20 11:53:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Attempting to detach device vdb from instance e0723ef5-96db-4191-84da-05eab21e5837 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:53:07 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:53:07 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:53:07 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:53:07 user nova-compute[74241]:   <serial>da9ea5e2-01dd-4e42-a98f-ba347f5f3711</serial>
Oct 20 11:53:07 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:53:07 user nova-compute[74241]: </disk>
Oct 20 11:53:07 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:53:07 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Successfully detached device vdb from instance e0723ef5-96db-4191-84da-05eab21e5837 from the persistent domain config.
Oct 20 11:53:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0723ef5-96db-4191-84da-05eab21e5837 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:53:07 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:53:07 user nova-compute[74241]:   <source dev="/dev/sde"/>
Oct 20 11:53:07 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:53:07 user nova-compute[74241]:   <serial>da9ea5e2-01dd-4e42-a98f-ba347f5f3711</serial>
Oct 20 11:53:07 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:53:07 user nova-compute[74241]: </disk>
Oct 20 11:53:07 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0723ef5-96db-4191-84da-05eab21e5837 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updating instance_info_cache with network_info: [{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:53:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:53:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:53:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:53:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:09 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:53:09 user nova-compute[74241]: INFO nova.compute.claims [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Claim successful on node user
Oct 20 11:53:10 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:53:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:53:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:53:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Creating image(s)
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "/opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "/opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "/opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk 1073741824" returned: 0 in 0.051s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG nova.policy [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f2c95648d124219b0505d18ebc85f5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2181a0d9a273487eaa81ad8acd48c8e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Cannot resize image /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Ensure instance console log exists: /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG nova.network.neutron [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Successfully created port: cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG nova.network.neutron [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Successfully updated port: cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquired lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG nova.network.neutron [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f92ef27-7e64-4c36-b187-752d2c5eee3f req-195d4e61-2be5-4846-8f14-28c674a37461 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-changed-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f92ef27-7e64-4c36-b187-752d2c5eee3f req-195d4e61-2be5-4846-8f14-28c674a37461 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Refreshing instance network info cache due to event network-changed-cc8f8122-a0f6-47f2-9cb4-436a2ba06999. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f92ef27-7e64-4c36-b187-752d2c5eee3f req-195d4e61-2be5-4846-8f14-28c674a37461 service nova] Acquiring lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:53:12 user nova-compute[74241]: DEBUG nova.network.neutron [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.network.neutron [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updating instance_info_cache with network_info: [{"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Releasing lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Instance network_info: |[{"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f92ef27-7e64-4c36-b187-752d2c5eee3f req-195d4e61-2be5-4846-8f14-28c674a37461 service nova] Acquired lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-3f92ef27-7e64-4c36-b187-752d2c5eee3f req-195d4e61-2be5-4846-8f14-28c674a37461 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Refreshing network info cache for port cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Start _get_guest_xml network_info=[{"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:53:13 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:53:13 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1054960772',display_name='tempest-AttachVolumeTestJSON-server-1054960772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1054960772',id=34,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+HOxyqEDaBErWs927nMVxdXwYJCkZ2nZVRay+eL0DDrMHbP0+eEqdjuHz5zxdAlhyfJqmgfB+XAhoOSAe5P2c96fny+qhJtnpj4sRm28zUYKfvbvFflGVnD8iPCXMntA==',key_name='tempest-keypair-396070698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-nddw9zf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=35e53445-2eb7-4f1f-99a7-256e33e442ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc8f8122-a0f6-47f2-9cb4-436a2ba06999,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f8122-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.objects.instance [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'pci_devices' on Instance uuid 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:53:13 user nova-compute[74241]:   <uuid>35e53445-2eb7-4f1f-99a7-256e33e442ca</uuid>
Oct 20 11:53:13 user nova-compute[74241]:   <name>instance-00000022</name>
Oct 20 11:53:13 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:53:13 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:53:13 user nova-compute[74241]:   <metadata>
Oct 20 11:53:13 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:53:13 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:53:13 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeTestJSON-server-1054960772</nova:name>
Oct 20 11:53:13 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:53:13</nova:creationTime>
Oct 20 11:53:13 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:53:13 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:53:13 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:53:13 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:53:13 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:53:13 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:53:13 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:53:13 user nova-compute[74241]:       <nova:owner>
Oct 20 11:53:13 user nova-compute[74241]:         <nova:user uuid="8f2c95648d124219b0505d18ebc85f5d">tempest-AttachVolumeTestJSON-1958556215-project-member</nova:user>
Oct 20 11:53:13 user nova-compute[74241]:         <nova:project uuid="2181a0d9a273487eaa81ad8acd48c8e9">tempest-AttachVolumeTestJSON-1958556215</nova:project>
Oct 20 11:53:13 user nova-compute[74241]:       </nova:owner>
Oct 20 11:53:13 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:53:13 user nova-compute[74241]:       <nova:ports>
Oct 20 11:53:13 user nova-compute[74241]:         <nova:port uuid="cc8f8122-a0f6-47f2-9cb4-436a2ba06999">
Oct 20 11:53:13 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 11:53:13 user nova-compute[74241]:         </nova:port>
Oct 20 11:53:13 user nova-compute[74241]:       </nova:ports>
Oct 20 11:53:13 user nova-compute[74241]:     </nova:instance>
Oct 20 11:53:13 user nova-compute[74241]:   </metadata>
Oct 20 11:53:13 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:53:13 user nova-compute[74241]:     <system>
Oct 20 11:53:13 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:53:13 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:53:13 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:53:13 user nova-compute[74241]:       <entry name="serial">35e53445-2eb7-4f1f-99a7-256e33e442ca</entry>
Oct 20 11:53:13 user nova-compute[74241]:       <entry name="uuid">35e53445-2eb7-4f1f-99a7-256e33e442ca</entry>
Oct 20 11:53:13 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:53:13 user nova-compute[74241]:     </system>
Oct 20 11:53:13 user nova-compute[74241]:   </sysinfo>
Oct 20 11:53:13 user nova-compute[74241]:   <os>
Oct 20 11:53:13 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:53:13 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:53:13 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:53:13 user nova-compute[74241]:   </os>
Oct 20 11:53:13 user nova-compute[74241]:   <features>
Oct 20 11:53:13 user nova-compute[74241]:     <acpi/>
Oct 20 11:53:13 user nova-compute[74241]:     <apic/>
Oct 20 11:53:13 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:53:13 user nova-compute[74241]:   </features>
Oct 20 11:53:13 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:53:13 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:53:13 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:53:13 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:53:13 user nova-compute[74241]:   </clock>
Oct 20 11:53:13 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:53:13 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:53:13 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:53:13 user nova-compute[74241]:   </cpu>
Oct 20 11:53:13 user nova-compute[74241]:   <devices>
Oct 20 11:53:13 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:53:13 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:53:13 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk"/>
Oct 20 11:53:13 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:53:13 user nova-compute[74241]:     </disk>
Oct 20 11:53:13 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:53:13 user nova-compute[74241]:       <mac address="fa:16:3e:e8:28:c0"/>
Oct 20 11:53:13 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:53:13 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:53:13 user nova-compute[74241]:       <target dev="tapcc8f8122-a0"/>
Oct 20 11:53:13 user nova-compute[74241]:     </interface>
Oct 20 11:53:13 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:53:13 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/console.log" append="off"/>
Oct 20 11:53:13 user nova-compute[74241]:     </serial>
Oct 20 11:53:13 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:53:13 user nova-compute[74241]:     <video>
Oct 20 11:53:13 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:53:13 user nova-compute[74241]:     </video>
Oct 20 11:53:13 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:53:13 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:53:13 user nova-compute[74241]:     </rng>
Oct 20 11:53:13 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:53:13 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:53:13 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:53:13 user nova-compute[74241]:     </memballoon>
Oct 20 11:53:13 user nova-compute[74241]:   </devices>
Oct 20 11:53:13 user nova-compute[74241]: </domain>
Oct 20 11:53:13 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1054960772',display_name='tempest-AttachVolumeTestJSON-server-1054960772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1054960772',id=34,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+HOxyqEDaBErWs927nMVxdXwYJCkZ2nZVRay+eL0DDrMHbP0+eEqdjuHz5zxdAlhyfJqmgfB+XAhoOSAe5P2c96fny+qhJtnpj4sRm28zUYKfvbvFflGVnD8iPCXMntA==',key_name='tempest-keypair-396070698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-nddw9zf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:53:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=35e53445-2eb7-4f1f-99a7-256e33e442ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc8f8122-a0f6-47f2-9cb4-436a2ba06999,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f8122-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG os_vif [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc8f8122-a0f6-47f2-9cb4-436a2ba06999,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f8122-a0') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bec3c747-d314-5129-96f6-0b1eb4768bba', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc8f8122-a0, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc8f8122-a0, col_values=(('qos', UUID('5ec226f2-8611-42e3-bb30-9b74f88050e3')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc8f8122-a0, col_values=(('external_ids', {'iface-id': 'cc8f8122-a0f6-47f2-9cb4-436a2ba06999', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:28:c0', 'vm-uuid': '35e53445-2eb7-4f1f-99a7-256e33e442ca'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:13 user nova-compute[74241]: INFO os_vif [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc8f8122-a0f6-47f2-9cb4-436a2ba06999,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f8122-a0')
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No VIF found with MAC fa:16:3e:e8:28:c0, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-3f92ef27-7e64-4c36-b187-752d2c5eee3f req-195d4e61-2be5-4846-8f14-28c674a37461 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updated VIF entry in instance network info cache for port cc8f8122-a0f6-47f2-9cb4-436a2ba06999. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-3f92ef27-7e64-4c36-b187-752d2c5eee3f req-195d4e61-2be5-4846-8f14-28c674a37461 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updating instance_info_cache with network_info: [{"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f92ef27-7e64-4c36-b187-752d2c5eee3f req-195d4e61-2be5-4846-8f14-28c674a37461 service nova] Releasing lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:14 user nova-compute[74241]: INFO nova.compute.manager [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Terminating instance
Oct 20 11:53:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-3d420d1a-447c-4fe3-94f2-bdec80812110 req-a6adf323-7c9f-4dec-8cb7-bb4690740c1b service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-unplugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3d420d1a-447c-4fe3-94f2-bdec80812110 req-a6adf323-7c9f-4dec-8cb7-bb4690740c1b service nova] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3d420d1a-447c-4fe3-94f2-bdec80812110 req-a6adf323-7c9f-4dec-8cb7-bb4690740c1b service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3d420d1a-447c-4fe3-94f2-bdec80812110 req-a6adf323-7c9f-4dec-8cb7-bb4690740c1b service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-3d420d1a-447c-4fe3-94f2-bdec80812110 req-a6adf323-7c9f-4dec-8cb7-bb4690740c1b service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] No waiting events found dispatching network-vif-unplugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-3d420d1a-447c-4fe3-94f2-bdec80812110 req-a6adf323-7c9f-4dec-8cb7-bb4690740c1b service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-unplugged-cc29a2ea-992b-40bd-a9fe-dc880128123a for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:53:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Instance destroyed successfully.
Oct 20 11:53:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'resources' on Instance uuid ec07982b-d7ea-4950-aca1-c6120927cfb0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:45:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1668348691',display_name='tempest-ServerActionsTestOtherA-server-1668348691',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1668348691',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-yx7a60yo',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:50:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=ec07982b-d7ea-4950-aca1-c6120927cfb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "address": "fa:16:3e:ea:5c:9e", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc29a2ea-99", "ovs_interfaceid": "cc29a2ea-992b-40bd-a9fe-dc880128123a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_vif [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc29a2ea-99, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6d1e782-a0fa-45f6-9399-c92b2ca4c03d) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:15 user nova-compute[74241]: INFO os_vif [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:5c:9e,bridge_name='br-int',has_traffic_filtering=True,id=cc29a2ea-992b-40bd-a9fe-dc880128123a,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc29a2ea-99')
Oct 20 11:53:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bQwNjaDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:53:15 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21f7eaa-a14d-4126-b242-5bfa623df2e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:53:15 user nova-compute[74241]: No targets found.
Oct 20 11:53:15 user nova-compute[74241]: iSNS:
Oct 20 11:53:15 user nova-compute[74241]: No targets found.
Oct 20 11:53:15 user nova-compute[74241]: STATIC:
Oct 20 11:53:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0
Oct 20 11:53:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a
Oct 20 11:53:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711
Oct 20 11:53:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:15 user nova-compute[74241]: FIRMWARE:
Oct 20 11:53:15 user nova-compute[74241]: No targets found.
Oct 20 11:53:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:53:15 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:53:15 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[05225e1f-90e1-41eb-b864-3e700c585aa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d464b07d-09f6-4b2b-be26-6c2816c9ff5d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:53:15 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:15 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a (non-flash)
Oct 20 11:53:15 user nova-compute[74241]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:15 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f520879f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d7eaaf-6dd2-4c0d-8663-4b3fe4b6b2ad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c48a58-65e6-4f8f-91fc-655f0e490b6b]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.090s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ea6085-439c-42de-a966-de7a7a9544aa]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[96347482-da8a-44ba-93af-9e690a38d825]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_7e791d23', '/dev/disk/by-id/scsi-23662376235636234', '/dev/disk/by-id/scsi-1SCST_BIO7e791d23-6b7b5cb4865c6279') {{(pid=85185) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[659fce17-2ebf-4d4d-9006-8486434d4a13]: (4, None) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e430e3a-5d15-4c21-9462-3f53b76a8682]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ed930f-14ab-44a9-bb0f-92dea9d540b9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260]
Oct 20 11:53:15 user nova-compute[74241]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a, portal: 172.16.0.220,3260] successful.
Oct 20 11:53:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c73cbcf1-5531-4645-9169-696fb9e4106a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bfb900-51cd-499c-a162-8f4a82b2c1c8]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] <== disconnect_volume: return (453ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:53:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Deleting instance files /opt/stack/data/nova/instances/ec07982b-d7ea-4950-aca1-c6120927cfb0_del
Oct 20 11:53:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Deletion of /opt/stack/data/nova/instances/ec07982b-d7ea-4950-aca1-c6120927cfb0_del complete
Oct 20 11:53:15 user nova-compute[74241]: INFO nova.compute.manager [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Took 1.45 seconds to destroy the instance on the hypervisor.
Oct 20 11:53:15 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:53:15 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:16 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Took 0.84 seconds to deallocate network for instance.
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-4a4334b3-e048-43aa-9031-e64a37252a8f req-ae0c51a6-3170-41f5-a91a-9425aa685fc5 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-deleted-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:16 user nova-compute[74241]: INFO nova.compute.manager [req-4a4334b3-e048-43aa-9031-e64a37252a8f req-ae0c51a6-3170-41f5-a91a-9425aa685fc5 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Neutron deleted interface cc29a2ea-992b-40bd-a9fe-dc880128123a; detaching it from the instance and deleting it from the info cache
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-4a4334b3-e048-43aa-9031-e64a37252a8f req-ae0c51a6-3170-41f5-a91a-9425aa685fc5 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-4a4334b3-e048-43aa-9031-e64a37252a8f req-ae0c51a6-3170-41f5-a91a-9425aa685fc5 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Detach interface failed, port_id=cc29a2ea-992b-40bd-a9fe-dc880128123a, reason: Instance ec07982b-d7ea-4950-aca1-c6120927cfb0 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Acquiring lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] No waiting events found dispatching network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:16 user nova-compute[74241]: WARNING nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Received unexpected event network-vif-plugged-cc29a2ea-992b-40bd-a9fe-dc880128123a for instance with vm_state active and task_state deleting.
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] No waiting events found dispatching network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:16 user nova-compute[74241]: WARNING nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received unexpected event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 for instance with vm_state building and task_state spawning.
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] No waiting events found dispatching network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:16 user nova-compute[74241]: WARNING nova.compute.manager [req-2bc9b404-4a50-4637-9d2c-e32c804a825e req-b9bc24fb-b8a0-4f07-ad80-7bdf7712f099 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received unexpected event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 for instance with vm_state building and task_state spawning.
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:53:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Instance spawned successfully.
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:17 user nova-compute[74241]: INFO nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Took 6.57 seconds to spawn the instance on the hypervisor.
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:53:17 user nova-compute[74241]: INFO nova.compute.manager [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Took 0.80 seconds to detach 1 volumes for instance.
Oct 20 11:53:17 user nova-compute[74241]: INFO nova.compute.manager [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Took 7.45 seconds to build instance.
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: ec07982b-d7ea-4950-aca1-c6120927cfb0] Deleting volume: c73cbcf1-5531-4645-9169-696fb9e4106a {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3b613dba-67ec-4fbb-aa3c-dc2d94a6abe7 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.551s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:53:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:17 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Deleted allocations for instance ec07982b-d7ea-4950-aca1-c6120927cfb0
Oct 20 11:53:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68d1892d-0b90-4d3e-a3cc-aa8809125621 tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "ec07982b-d7ea-4950-aca1-c6120927cfb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.779s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVPXDgaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:53:22 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:53:22 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:53:22 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[513d2753-8bc6-44fb-8d09-903d2188165a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:53:22 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dbd28f-32a7-4709-a3fa-f7dbf19e733d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa] added
Oct 20 11:53:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[facd0542-61d0-4a9d-968a-0062a104f529]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1508515-f2c1-4a0b-8334-18a8ed43a4c4]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVPXDgaM {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KVPXDgaM" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c3053c-ae6b-4327-b413-c704de4dad06]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KVPXDgaM'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a2880a-1fbb-480d-b0ce-1a425f25330b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb41d07-cc30-442a-9c1b-a2dac48e6ee1]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:22 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:22 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:53:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Creating image(s)
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Ensure instance console log exists: /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Start _get_guest_xml network_info=[{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '5d9b0b05-88c8-48d0-a760-f2166c366b0c', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSpvcYWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ab397f5-6d89-4bc6-b1e5-10cb423f5f91', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'serial': 'ae6c9492-d5a5-4f68-b809-4a50aec8c6c7'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:53:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSpvcYWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:53:22 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f7800a-1aab-4447-a563-868fef8906de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa, portal: 172.16.0.220,3260]
Oct 20 11:53:22 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa, portal: 172.16.0.220,3260] successful.
Oct 20 11:53:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[216eee71-7988-492d-9f32-03b17cde70fa]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d956ce6-02d8-4c7a-a0de-c01afd3aed8c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:22 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:22 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:22 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:22 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2880ca65-99d0-4b63-b842-205f809903ba]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:53:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVPXDgaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23235323235616663', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235323235616663', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.106s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:53:23 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:53:23 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG nova.objects.instance [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'flavor' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0523bb-6402-434c-972f-6af2c1c5fe62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:53:23 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:53:23 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:53:23 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:53:23 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:53:23 user nova-compute[74241]:   <serial>b1fd0cc6-8526-49ac-8f16-da9747940bfa</serial>
Oct 20 11:53:23 user nova-compute[74241]: </disk>
Oct 20 11:53:23 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[af24ae4c-b621-4bc4-b9d8-5db15398699d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7] added
Oct 20 11:53:23 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[438ebbba-8267-4fe3-8705-5262c040fa8e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedbffae-b6ea-4f0a-841c-bdb4967db606]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSpvcYWX {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSpvcYWX" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d0574-b9bc-450b-991e-059d8e3219ec]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oSpvcYWX'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c35b7c-ced4-428b-bde6-9ea2a31303dd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa9f83c-2bc6-4ed8-8798-b6b351819a21]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:23 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:23 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:23 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:23 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:23 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:23 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:53:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeef9a4-e4b6-49f2-90cb-648acbe6bbb9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7, portal: 172.16.0.220,3260]
Oct 20 11:53:24 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7, portal: 172.16.0.220,3260] successful.
Oct 20 11:53:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eb9389-1a59-493a-bbc5-65d3bed3b440]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[26571d46-f563-461b-a3d0-757e08a1caa8]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:24 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:24 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:24 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:53:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:24 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:24 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:24 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:53:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2c39a2-9681-47cf-95a8-c8154b00f2e0]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSpvcYWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No VIF found with MAC fa:16:3e:38:10:a9, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:53:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-71294292-c06e-4d3f-970a-6df721881e89 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.337s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] <== connect_volume: return (2431ms) {'type': 'block', 'scsi_wwn': '26537346132626435', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537346132626435', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-822068380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-822068380',id=32,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-d71hdc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:52:42Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=9ab397f5-6d89-4bc6-b1e5-10cb423f5f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:a7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8cd19fc4-d5a2-429e-a495-de7e92ccb893,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd19fc4-d5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:53:25 user nova-compute[74241]:   <uuid>9ab397f5-6d89-4bc6-b1e5-10cb423f5f91</uuid>
Oct 20 11:53:25 user nova-compute[74241]:   <name>instance-00000020</name>
Oct 20 11:53:25 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:53:25 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:53:25 user nova-compute[74241]:   <metadata>
Oct 20 11:53:25 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:53:25 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:53:25 user nova-compute[74241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-822068380</nova:name>
Oct 20 11:53:25 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:53:22</nova:creationTime>
Oct 20 11:53:25 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:53:25 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:53:25 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:53:25 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:53:25 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:53:25 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:53:25 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:53:25 user nova-compute[74241]:       <nova:owner>
Oct 20 11:53:25 user nova-compute[74241]:         <nova:user uuid="0c611c28a9264820a26f203045040420">tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member</nova:user>
Oct 20 11:53:25 user nova-compute[74241]:         <nova:project uuid="52f8151a0cf44b2d89838da474c2dc68">tempest-ServerBootFromVolumeStableRescueTest-929360393</nova:project>
Oct 20 11:53:25 user nova-compute[74241]:       </nova:owner>
Oct 20 11:53:25 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:53:25 user nova-compute[74241]:       <nova:ports>
Oct 20 11:53:25 user nova-compute[74241]:         <nova:port uuid="8cd19fc4-d5a2-429e-a495-de7e92ccb893">
Oct 20 11:53:25 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 11:53:25 user nova-compute[74241]:         </nova:port>
Oct 20 11:53:25 user nova-compute[74241]:       </nova:ports>
Oct 20 11:53:25 user nova-compute[74241]:     </nova:instance>
Oct 20 11:53:25 user nova-compute[74241]:   </metadata>
Oct 20 11:53:25 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:53:25 user nova-compute[74241]:     <system>
Oct 20 11:53:25 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:53:25 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:53:25 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:53:25 user nova-compute[74241]:       <entry name="serial">9ab397f5-6d89-4bc6-b1e5-10cb423f5f91</entry>
Oct 20 11:53:25 user nova-compute[74241]:       <entry name="uuid">9ab397f5-6d89-4bc6-b1e5-10cb423f5f91</entry>
Oct 20 11:53:25 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:53:25 user nova-compute[74241]:     </system>
Oct 20 11:53:25 user nova-compute[74241]:   </sysinfo>
Oct 20 11:53:25 user nova-compute[74241]:   <os>
Oct 20 11:53:25 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:53:25 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:53:25 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:53:25 user nova-compute[74241]:   </os>
Oct 20 11:53:25 user nova-compute[74241]:   <features>
Oct 20 11:53:25 user nova-compute[74241]:     <acpi/>
Oct 20 11:53:25 user nova-compute[74241]:     <apic/>
Oct 20 11:53:25 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:53:25 user nova-compute[74241]:   </features>
Oct 20 11:53:25 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:53:25 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:53:25 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:53:25 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:53:25 user nova-compute[74241]:   </clock>
Oct 20 11:53:25 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:53:25 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:53:25 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:53:25 user nova-compute[74241]:   </cpu>
Oct 20 11:53:25 user nova-compute[74241]:   <devices>
Oct 20 11:53:25 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:53:25 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:53:25 user nova-compute[74241]:       <source dev="/dev/sdd"/>
Oct 20 11:53:25 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:53:25 user nova-compute[74241]:       <serial>ae6c9492-d5a5-4f68-b809-4a50aec8c6c7</serial>
Oct 20 11:53:25 user nova-compute[74241]:     </disk>
Oct 20 11:53:25 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:53:25 user nova-compute[74241]:       <mac address="fa:16:3e:44:a7:8a"/>
Oct 20 11:53:25 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:53:25 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:53:25 user nova-compute[74241]:       <target dev="tap8cd19fc4-d5"/>
Oct 20 11:53:25 user nova-compute[74241]:     </interface>
Oct 20 11:53:25 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:53:25 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/console.log" append="off"/>
Oct 20 11:53:25 user nova-compute[74241]:     </serial>
Oct 20 11:53:25 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:53:25 user nova-compute[74241]:     <video>
Oct 20 11:53:25 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:53:25 user nova-compute[74241]:     </video>
Oct 20 11:53:25 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:53:25 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:53:25 user nova-compute[74241]:     </rng>
Oct 20 11:53:25 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:53:25 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:53:25 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:53:25 user nova-compute[74241]:     </memballoon>
Oct 20 11:53:25 user nova-compute[74241]:   </devices>
Oct 20 11:53:25 user nova-compute[74241]: </domain>
Oct 20 11:53:25 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-822068380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-822068380',id=32,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-d71hdc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:52:42Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=9ab397f5-6d89-4bc6-b1e5-10cb423f5f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:a7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8cd19fc4-d5a2-429e-a495-de7e92ccb893,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd19fc4-d5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG os_vif [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:a7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8cd19fc4-d5a2-429e-a495-de7e92ccb893,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd19fc4-d5') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02c92040-4c59-5101-a278-2e1c56962078', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cd19fc4-d5, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cd19fc4-d5, col_values=(('qos', UUID('76a4ca2d-ccfe-42ec-8b9d-e977dcabf0af')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cd19fc4-d5, col_values=(('external_ids', {'iface-id': '8cd19fc4-d5a2-429e-a495-de7e92ccb893', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:a7:8a', 'vm-uuid': '9ab397f5-6d89-4bc6-b1e5-10cb423f5f91'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:25 user nova-compute[74241]: INFO os_vif [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:a7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8cd19fc4-d5a2-429e-a495-de7e92ccb893,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd19fc4-d5')
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No VIF found with MAC fa:16:3e:44:a7:8a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:53:25 user nova-compute[74241]: INFO nova.compute.manager [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Rescuing
Oct 20 11:53:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquired lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Releasing lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-4fe2ad7d-0a1b-4b76-8109-8c21350ffd3d req-2b743a0d-5b81-4108-8ea7-0b21271de938 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4fe2ad7d-0a1b-4b76-8109-8c21350ffd3d req-2b743a0d-5b81-4108-8ea7-0b21271de938 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4fe2ad7d-0a1b-4b76-8109-8c21350ffd3d req-2b743a0d-5b81-4108-8ea7-0b21271de938 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4fe2ad7d-0a1b-4b76-8109-8c21350ffd3d req-2b743a0d-5b81-4108-8ea7-0b21271de938 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-4fe2ad7d-0a1b-4b76-8109-8c21350ffd3d req-2b743a0d-5b81-4108-8ea7-0b21271de938 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:26 user nova-compute[74241]: WARNING nova.compute.manager [req-4fe2ad7d-0a1b-4b76-8109-8c21350ffd3d req-2b743a0d-5b81-4108-8ea7-0b21271de938 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state active and task_state rescuing.
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-50a90bd4-e878-4868-ba89-047144be3feb req-658035dc-d58d-4182-82dd-bc5e957f9ee1 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-50a90bd4-e878-4868-ba89-047144be3feb req-658035dc-d58d-4182-82dd-bc5e957f9ee1 service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-50a90bd4-e878-4868-ba89-047144be3feb req-658035dc-d58d-4182-82dd-bc5e957f9ee1 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-50a90bd4-e878-4868-ba89-047144be3feb req-658035dc-d58d-4182-82dd-bc5e957f9ee1 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG nova.compute.manager [req-50a90bd4-e878-4868-ba89-047144be3feb req-658035dc-d58d-4182-82dd-bc5e957f9ee1 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:26 user nova-compute[74241]: WARNING nova.compute.manager [req-50a90bd4-e878-4868-ba89-047144be3feb req-658035dc-d58d-4182-82dd-bc5e957f9ee1 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state building and task_state spawning.
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:27 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance destroyed successfully.
Oct 20 11:53:27 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Attempting rescue
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance directory exists: not creating {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 11:53:27 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Creating image(s)
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'trusted_certs' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue" returned: 0 in 0.055s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'migration_context' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:27 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0723ef5-96db-4191-84da-05eab21e5837 is timed out.
Oct 20 11:53:27 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Successfully detached device vdb from instance e0723ef5-96db-4191-84da-05eab21e5837 from the live domain config.
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.base [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<e1bd5ec5-ad87-45bd-ba69-ad979258a9be> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Start _get_guest_xml network_info=[{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:38:10:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'resources' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYCLvKPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:53:27 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.base [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<e1bd5ec5-ad87-45bd-ba69-ad979258a9be> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'numa_topology' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.base [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<e1bd5ec5-ad87-45bd-ba69-ad979258a9be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:53:27 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:53:27 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5378ae-7ef9-4811-bf16-4ddbfaa0a758]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:53:27 user nova-compute[74241]: No targets found.
Oct 20 11:53:27 user nova-compute[74241]: iSNS:
Oct 20 11:53:27 user nova-compute[74241]: No targets found.
Oct 20 11:53:27 user nova-compute[74241]: STATIC:
Oct 20 11:53:27 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0
Oct 20 11:53:27 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:27 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:27 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa
Oct 20 11:53:27 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:27 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:27 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:53:27 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:27 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:27 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711
Oct 20 11:53:27 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:27 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:27 user nova-compute[74241]: FIRMWARE:
Oct 20 11:53:27 user nova-compute[74241]: No targets found.
Oct 20 11:53:27 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:53:27 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:53:27 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ef9704-b550-4a2e-8726-999ea51fd310]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.base [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<e1bd5ec5-ad87-45bd-ba69-ad979258a9be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-550887458',display_name='tempest-ServerRescueNegativeTestJSON-server-550887458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-550887458',id=31,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE97RzNueek15qvzFipBWLRsLZQicogNQi2U1snsTzV3Rlzzpvue1LEwiFCPaIiUMWBmryDPeNhiqsYhY3dRen8M1Ue/Y27ILFXFAoMJAr7pdJBrh/acghFPHguk3gSUAw==',key_name='tempest-keypair-1249799456',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-4srw336e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=e1bd5ec5-ad87-45bd-ba69-ad979258a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:38:10:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "vif_mac": "fa:16:3e:38:10:a9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:10:a9,bridge_name='br-int',has_traffic_filtering=True,id=d7f9f66f-674b-41d6-9460-5f0be423b6d1,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f9f66f-67') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'pci_devices' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18e91cd-d224-4de0-aebd-0096ed6f24c6]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:27 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:27 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:27 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:53:27 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:27 user nova-compute[74241]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 (non-flash)
Oct 20 11:53:27 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:27 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:53:27 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f520879db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711'): ({'sde'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Removing single pathed devices sde {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.objects.base [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Object Instance<e1bd5ec5-ad87-45bd-ba69-ad979258a9be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:53:27 user nova-compute[74241]:   <uuid>e1bd5ec5-ad87-45bd-ba69-ad979258a9be</uuid>
Oct 20 11:53:27 user nova-compute[74241]:   <name>instance-0000001f</name>
Oct 20 11:53:27 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:53:27 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:53:27 user nova-compute[74241]:   <metadata>
Oct 20 11:53:27 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:53:27 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:53:27 user nova-compute[74241]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-550887458</nova:name>
Oct 20 11:53:27 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:53:27</nova:creationTime>
Oct 20 11:53:27 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:53:27 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:53:27 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:53:27 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:53:27 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:53:27 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:53:27 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:53:27 user nova-compute[74241]:       <nova:owner>
Oct 20 11:53:27 user nova-compute[74241]:         <nova:user uuid="6ad19e5d57684ea2ae450fcc53ca8bd7">tempest-ServerRescueNegativeTestJSON-1505666936-project-member</nova:user>
Oct 20 11:53:27 user nova-compute[74241]:         <nova:project uuid="6b379f1e29f94071a26728bdb59bbfcb">tempest-ServerRescueNegativeTestJSON-1505666936</nova:project>
Oct 20 11:53:27 user nova-compute[74241]:       </nova:owner>
Oct 20 11:53:27 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:53:27 user nova-compute[74241]:       <nova:ports>
Oct 20 11:53:27 user nova-compute[74241]:         <nova:port uuid="d7f9f66f-674b-41d6-9460-5f0be423b6d1">
Oct 20 11:53:27 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 11:53:27 user nova-compute[74241]:         </nova:port>
Oct 20 11:53:27 user nova-compute[74241]:       </nova:ports>
Oct 20 11:53:27 user nova-compute[74241]:     </nova:instance>
Oct 20 11:53:27 user nova-compute[74241]:   </metadata>
Oct 20 11:53:27 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:53:27 user nova-compute[74241]:     <system>
Oct 20 11:53:27 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:53:27 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:53:27 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:53:27 user nova-compute[74241]:       <entry name="serial">e1bd5ec5-ad87-45bd-ba69-ad979258a9be</entry>
Oct 20 11:53:27 user nova-compute[74241]:       <entry name="uuid">e1bd5ec5-ad87-45bd-ba69-ad979258a9be</entry>
Oct 20 11:53:27 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:53:27 user nova-compute[74241]:     </system>
Oct 20 11:53:27 user nova-compute[74241]:   </sysinfo>
Oct 20 11:53:27 user nova-compute[74241]:   <os>
Oct 20 11:53:27 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:53:27 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:53:27 user nova-compute[74241]:   </os>
Oct 20 11:53:27 user nova-compute[74241]:   <features>
Oct 20 11:53:27 user nova-compute[74241]:     <acpi/>
Oct 20 11:53:27 user nova-compute[74241]:     <apic/>
Oct 20 11:53:27 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:53:27 user nova-compute[74241]:   </features>
Oct 20 11:53:27 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:53:27 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:53:27 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:53:27 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:53:27 user nova-compute[74241]:   </clock>
Oct 20 11:53:27 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:53:27 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:53:27 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:53:27 user nova-compute[74241]:   </cpu>
Oct 20 11:53:27 user nova-compute[74241]:   <devices>
Oct 20 11:53:27 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:53:27 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:53:27 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue"/>
Oct 20 11:53:27 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:53:27 user nova-compute[74241]:     </disk>
Oct 20 11:53:27 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:53:27 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:53:27 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk"/>
Oct 20 11:53:27 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:53:27 user nova-compute[74241]:     </disk>
Oct 20 11:53:27 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:53:27 user nova-compute[74241]:       <mac address="fa:16:3e:38:10:a9"/>
Oct 20 11:53:27 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:53:27 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:53:27 user nova-compute[74241]:       <target dev="tapd7f9f66f-67"/>
Oct 20 11:53:27 user nova-compute[74241]:     </interface>
Oct 20 11:53:27 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:53:27 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/console.log" append="off"/>
Oct 20 11:53:27 user nova-compute[74241]:     </serial>
Oct 20 11:53:27 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:53:27 user nova-compute[74241]:     <video>
Oct 20 11:53:27 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:53:27 user nova-compute[74241]:     </video>
Oct 20 11:53:27 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:53:27 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:53:27 user nova-compute[74241]:     </rng>
Oct 20 11:53:27 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:53:27 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:53:27 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:53:27 user nova-compute[74241]:     </memballoon>
Oct 20 11:53:27 user nova-compute[74241]:   </devices>
Oct 20 11:53:27 user nova-compute[74241]: </domain>
Oct 20 11:53:27 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c591713-cfd9-46a6-80e0-ffadaa5152fd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance destroyed successfully.
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c4637b-94c3-4e3f-9219-9821a6996840]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Flushing IO for device /dev/sde {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[518c7664-3239-4555-a938-ea73e48f271b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] No VIF found with MAC fa:16:3e:38:10:a9, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[802e2871-7ff8-45aa-a0af-5738c613aa6d]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8e200b-6f89-40d1-95c8-051133df885e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a6bac-01b1-4d4d-99a6-23b0aa534b91]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711, portal: 172.16.0.220,3260]
Oct 20 11:53:27 user nova-compute[74241]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711, portal: 172.16.0.220,3260] successful.
Oct 20 11:53:27 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7600bd78-d836-4a8d-983b-b4393ce4854c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] <== disconnect_volume: return (351ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:53:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-7791e0b3-9db3-4f4f-a9d6-719b0c9e636f req-86fb0d58-cbc9-4bf9-a655-46d324d71b93 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7791e0b3-9db3-4f4f-a9d6-719b0c9e636f req-86fb0d58-cbc9-4bf9-a655-46d324d71b93 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7791e0b3-9db3-4f4f-a9d6-719b0c9e636f req-86fb0d58-cbc9-4bf9-a655-46d324d71b93 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7791e0b3-9db3-4f4f-a9d6-719b0c9e636f req-86fb0d58-cbc9-4bf9-a655-46d324d71b93 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-7791e0b3-9db3-4f4f-a9d6-719b0c9e636f req-86fb0d58-cbc9-4bf9-a655-46d324d71b93 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:28 user nova-compute[74241]: WARNING nova.compute.manager [req-7791e0b3-9db3-4f4f-a9d6-719b0c9e636f req-86fb0d58-cbc9-4bf9-a655-46d324d71b93 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state active and task_state rescuing.
Oct 20 11:53:28 user nova-compute[74241]: DEBUG nova.objects.instance [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'flavor' on Instance uuid e0723ef5-96db-4191-84da-05eab21e5837 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-14495064-0c65-4571-ac2f-72161a48b093 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.856s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.718s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:28 user nova-compute[74241]: INFO nova.compute.manager [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Terminating instance
Oct 20 11:53:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-29c55a03-db70-41e1-8193-604ac8551276 req-19e1637b-bb1d-40cf-943c-c10514215b98 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-29c55a03-db70-41e1-8193-604ac8551276 req-19e1637b-bb1d-40cf-943c-c10514215b98 service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-29c55a03-db70-41e1-8193-604ac8551276 req-19e1637b-bb1d-40cf-943c-c10514215b98 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-29c55a03-db70-41e1-8193-604ac8551276 req-19e1637b-bb1d-40cf-943c-c10514215b98 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:28 user nova-compute[74241]: DEBUG nova.compute.manager [req-29c55a03-db70-41e1-8193-604ac8551276 req-19e1637b-bb1d-40cf-943c-c10514215b98 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:28 user nova-compute[74241]: WARNING nova.compute.manager [req-29c55a03-db70-41e1-8193-604ac8551276 req-19e1637b-bb1d-40cf-943c-c10514215b98 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state building and task_state spawning.
Oct 20 11:53:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:53:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance spawned successfully.
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:53:29 user nova-compute[74241]: INFO nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Took 6.77 seconds to spawn the instance on the hypervisor.
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:53:29 user nova-compute[74241]: INFO nova.compute.manager [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Took 47.62 seconds to build instance.
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bfb9d288-2f76-4ebf-873c-336cb775aea4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.712s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Instance destroyed successfully.
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.objects.instance [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'resources' on Instance uuid e0723ef5-96db-4191-84da-05eab21e5837 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1028793549',display_name='tempest-VolumesSnapshotTestJSON-instance-1028793549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1028793549',id=29,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYv5uHlwb3rIpGuwMRLMXi+ZmFw/QAQDJFm0tOELWr569P/x4ZTs7G5A49B56wzvaqQYh+Zne03KsAQ9sjLXXlkhwytSjY8GmZI2kpMRqHosjxfeTiMYEB54mbs3OHFCA==',key_name='tempest-keypair-618012453',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:49:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4764e42940fd415986f661c0abfe5e5b',ramdisk_id='',reservation_id='r-m6650tol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-740119974',owner_user_name='tempest-VolumesSnapshotTestJSON-740119974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:49:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f1fe587313141b488e5975c3e72c571',uuid=e0723ef5-96db-4191-84da-05eab21e5837,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converting VIF {"id": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "address": "fa:16:3e:fc:76:9b", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8f2db4-3d", "ovs_interfaceid": "3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f2db4-3d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_vif [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f2db4-3d') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e8f2db4-3d, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e2e56f5-449a-4c84-927b-14f104386e6f) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:29 user nova-compute[74241]: INFO os_vif [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:76:9b,bridge_name='br-int',has_traffic_filtering=True,id=3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8f2db4-3d')
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYCLvKPt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:53:29 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7735e35-e287-464b-a7ac-7d9851d36215]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:53:29 user nova-compute[74241]: No targets found.
Oct 20 11:53:29 user nova-compute[74241]: iSNS:
Oct 20 11:53:29 user nova-compute[74241]: No targets found.
Oct 20 11:53:29 user nova-compute[74241]: STATIC:
Oct 20 11:53:29 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0
Oct 20 11:53:29 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:29 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:29 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa
Oct 20 11:53:29 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:29 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:29 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:53:29 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:53:29 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:53:29 user nova-compute[74241]: FIRMWARE:
Oct 20 11:53:29 user nova-compute[74241]: No targets found.
Oct 20 11:53:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:53:29 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:53:29 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da9ea5e2-01dd-4e42-a98f-ba347f5f3711', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54b129e-38e8-4cac-9b97-5d5f2ae71716]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a053dc23-3fc3-43d6-9a15-0d58fe860927]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:29 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:29 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:53:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:53:29 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:53:29 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:53:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52085f5870>, {}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Disconnecting from: [] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] <== disconnect_volume: return (88ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:53:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:53:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Deleting instance files /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837_del
Oct 20 11:53:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Deletion of /opt/stack/data/nova/instances/e0723ef5-96db-4191-84da-05eab21e5837_del complete
Oct 20 11:53:30 user nova-compute[74241]: INFO nova.compute.manager [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Took 1.30 seconds to destroy the instance on the hypervisor.
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: e0723ef5-96db-4191-84da-05eab21e5837] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:30 user nova-compute[74241]: WARNING nova.compute.manager [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state active and task_state rescuing.
Oct 20 11:53:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:30 user nova-compute[74241]: WARNING nova.compute.manager [req-86494a9a-a9c2-42e7-881b-88ae100fd5e0 req-d77fdd12-ba71-4dc8-bbf6-878919e42f27 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state active and task_state rescuing.
Oct 20 11:53:30 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:30 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Took 0.78 seconds to deallocate network for instance.
Oct 20 11:53:30 user nova-compute[74241]: WARNING nova.volume.cinder [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Attachment 6a76e093-d534-445a-9346-6459ba5ec36f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6a76e093-d534-445a-9346-6459ba5ec36f. (HTTP 404) (Request-ID: req-a88e2433-f8b6-45b9-bfbf-e967e1358c4d)
Oct 20 11:53:30 user nova-compute[74241]: INFO nova.compute.manager [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received event network-vif-unplugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] No waiting events found dispatching network-vif-unplugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:31 user nova-compute[74241]: WARNING nova.compute.manager [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received unexpected event network-vif-unplugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 for instance with vm_state deleted and task_state None.
Oct 20 11:53:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received event network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] Acquiring lock "e0723ef5-96db-4191-84da-05eab21e5837-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] Lock "e0723ef5-96db-4191-84da-05eab21e5837-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] No waiting events found dispatching network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:53:31 user nova-compute[74241]: WARNING nova.compute.manager [req-0b184592-a3dd-4035-9912-0311e112d417 req-e75e9323-392c-40c5-9074-63431e960f8b service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received unexpected event network-vif-plugged-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 for instance with vm_state deleted and task_state None.
Oct 20 11:53:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-f5d5f6e3-e420-43e8-8848-3fd02221bfa2 req-ddf7ffc1-9907-422c-853a-fe8c743d467f service nova] [instance: e0723ef5-96db-4191-84da-05eab21e5837] Received event network-vif-deleted-3e8f2db4-3d2f-4f33-9f8e-41f3637ab2a2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:31 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Deleted allocations for instance e0723ef5-96db-4191-84da-05eab21e5837
Oct 20 11:53:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-49d8f04b-ddad-4138-bf0b-181a42552080 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "e0723ef5-96db-4191-84da-05eab21e5837" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.734s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:53:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6b00657c-0025-4e31-b9f5-34939d5f0e92 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:53:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-8a004df8-c52b-4197-bf4d-4bd2c4c7ad08 req-18c5bd83-76c6-4a8c-b107-56e44e6e1766 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-8a004df8-c52b-4197-bf4d-4bd2c4c7ad08 req-18c5bd83-76c6-4a8c-b107-56e44e6e1766 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing instance network info cache due to event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:53:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8a004df8-c52b-4197-bf4d-4bd2c4c7ad08 req-18c5bd83-76c6-4a8c-b107-56e44e6e1766 service nova] Acquiring lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:53:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8a004df8-c52b-4197-bf4d-4bd2c4c7ad08 req-18c5bd83-76c6-4a8c-b107-56e44e6e1766 service nova] Acquired lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:53:51 user nova-compute[74241]: DEBUG nova.network.neutron [req-8a004df8-c52b-4197-bf4d-4bd2c4c7ad08 req-18c5bd83-76c6-4a8c-b107-56e44e6e1766 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:53:51 user nova-compute[74241]: DEBUG nova.network.neutron [req-8a004df8-c52b-4197-bf4d-4bd2c4c7ad08 req-18c5bd83-76c6-4a8c-b107-56e44e6e1766 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updated VIF entry in instance network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:53:51 user nova-compute[74241]: DEBUG nova.network.neutron [req-8a004df8-c52b-4197-bf4d-4bd2c4c7ad08 req-18c5bd83-76c6-4a8c-b107-56e44e6e1766 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating instance_info_cache with network_info: [{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8a004df8-c52b-4197-bf4d-4bd2c4c7ad08 req-18c5bd83-76c6-4a8c-b107-56e44e6e1766 service nova] Releasing lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.compute.manager [req-8dec6658-e9f4-487a-8f3d-6006df56cdaf req-eb41f358-0b30-4657-916f-443ff4312d1f service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.compute.manager [req-8dec6658-e9f4-487a-8f3d-6006df56cdaf req-eb41f358-0b30-4657-916f-443ff4312d1f service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing instance network info cache due to event network-changed-b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8dec6658-e9f4-487a-8f3d-6006df56cdaf req-eb41f358-0b30-4657-916f-443ff4312d1f service nova] Acquiring lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8dec6658-e9f4-487a-8f3d-6006df56cdaf req-eb41f358-0b30-4657-916f-443ff4312d1f service nova] Acquired lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-8dec6658-e9f4-487a-8f3d-6006df56cdaf req-eb41f358-0b30-4657-916f-443ff4312d1f service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Refreshing network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:53:52 user nova-compute[74241]: INFO nova.compute.manager [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Detaching volume acb3a9db-471d-4232-a95c-a21d445912b0
Oct 20 11:53:52 user nova-compute[74241]: INFO nova.virt.block_device [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Attempting to driver detach volume acb3a9db-471d-4232-a95c-a21d445912b0 from mountpoint /dev/vdb
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Attempting to detach device vdb from instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:53:52 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:53:52 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:53:52 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:53:52 user nova-compute[74241]:   <serial>acb3a9db-471d-4232-a95c-a21d445912b0</serial>
Oct 20 11:53:52 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 11:53:52 user nova-compute[74241]: </disk>
Oct 20 11:53:52 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:53:52 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully detached device vdb from instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 from the persistent domain config.
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:53:52 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:53:52 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:53:52 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:53:52 user nova-compute[74241]:   <serial>acb3a9db-471d-4232-a95c-a21d445912b0</serial>
Oct 20 11:53:52 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 11:53:52 user nova-compute[74241]: </disk>
Oct 20 11:53:52 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-8dec6658-e9f4-487a-8f3d-6006df56cdaf req-eb41f358-0b30-4657-916f-443ff4312d1f service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updated VIF entry in instance network info cache for port b6096fc9-6928-4d9e-9066-9174bd327ff2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-8dec6658-e9f4-487a-8f3d-6006df56cdaf req-eb41f358-0b30-4657-916f-443ff4312d1f service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating instance_info_cache with network_info: [{"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8dec6658-e9f4-487a-8f3d-6006df56cdaf req-eb41f358-0b30-4657-916f-443ff4312d1f service nova] Releasing lock "refresh_cache-5b6ea39f-b167-480f-a288-d9bcf55434d2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:53:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:53:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:54:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:54:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:54:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:54:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:54:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=25.267192840576172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:54:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f289e23f-cab7-4631-9c80-6b0391bbea89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance d24bf60b-6e03-4708-a615-1a2b42869cfe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 35e53445-2eb7-4f1f-99a7-256e33e442ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 11:54:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 11:54:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:54:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:54:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:54:07 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:54:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updating instance_info_cache with network_info: [{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:54:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:54:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:54:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:54:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:54:12 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 is timed out.
Oct 20 11:54:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully detached device vdb from instance 5b6ea39f-b167-480f-a288-d9bcf55434d2 from the live domain config.
Oct 20 11:54:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moZdWGMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:54:12 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1681a09d-d5d0-40b5-9ff4-4a73fd437652]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:54:12 user nova-compute[74241]: No targets found.
Oct 20 11:54:12 user nova-compute[74241]: iSNS:
Oct 20 11:54:12 user nova-compute[74241]: No targets found.
Oct 20 11:54:12 user nova-compute[74241]: STATIC:
Oct 20 11:54:12 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0
Oct 20 11:54:12 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:54:12 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:54:12 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa
Oct 20 11:54:12 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:54:12 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:54:12 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:54:12 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:54:12 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:54:12 user nova-compute[74241]: FIRMWARE:
Oct 20 11:54:12 user nova-compute[74241]: No targets found.
Oct 20 11:54:12 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:54:12 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:54:12 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88139fb-7570-4e4f-9440-300aa99fb171]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6615f7bd-0b9e-4526-862b-1039a0520101]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:54:12 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:54:12 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:54:12 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 (non-flash)
Oct 20 11:54:12 user nova-compute[74241]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:54:12 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:54:12 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f524b78b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[67049c66-5f74-4c60-b6fb-513dc1ace2f8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3035a05f-8f7a-4494-9f32-ad287fa3fbf7]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee2ad1-8301-47df-a3a5-93a70555bec9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:54:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ca239e-2cff-486c-b6eb-2ef261cf33b3]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f48949-2b96-4a6e-9d57-58b7b1cda964]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[12567761-cd69-482b-86b1-96da29e07f91]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260]
Oct 20 11:54:13 user nova-compute[74241]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0, portal: 172.16.0.220,3260] successful.
Oct 20 11:54:13 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:acb3a9db-471d-4232-a95c-a21d445912b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe0fc7a-c8bb-4efc-b5ea-83902588c5b7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] <== disconnect_volume: return (324ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:54:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:54:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'flavor' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-10270c28-c454-427c-89f4-0b83d4cb65f6 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.332s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:15 user nova-compute[74241]: INFO nova.compute.manager [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Terminating instance
Oct 20 11:54:15 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-a296c199-0efc-4412-af8b-7d27df5d91c4 req-fc6db0d0-1acd-471f-8592-3dcf1f70d52f service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-vif-unplugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a296c199-0efc-4412-af8b-7d27df5d91c4 req-fc6db0d0-1acd-471f-8592-3dcf1f70d52f service nova] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a296c199-0efc-4412-af8b-7d27df5d91c4 req-fc6db0d0-1acd-471f-8592-3dcf1f70d52f service nova] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a296c199-0efc-4412-af8b-7d27df5d91c4 req-fc6db0d0-1acd-471f-8592-3dcf1f70d52f service nova] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-a296c199-0efc-4412-af8b-7d27df5d91c4 req-fc6db0d0-1acd-471f-8592-3dcf1f70d52f service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] No waiting events found dispatching network-vif-unplugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.compute.manager [req-a296c199-0efc-4412-af8b-7d27df5d91c4 req-fc6db0d0-1acd-471f-8592-3dcf1f70d52f service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-vif-unplugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Instance destroyed successfully.
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lazy-loading 'resources' on Instance uuid f289e23f-cab7-4631-9c80-6b0391bbea89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:32:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-6794331',display_name='tempest-ServerActionsTestOtherA-server-6794331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-6794331',id=3,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdkAJGl3eo1OVHw5t7Gf/0sOI3yPpUNJONC9JrzJtj6S4jXsG8JGcX7qVtlEfTt6ol7QTHbsAGAtaGEEcRoyu8TjD9zh8uLquJJLPIWcsgKoHSwEggu2wljCtxM1A7aYQ==',key_name='tempest-keypair-747534464',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:33:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4449c61c4f64b2f96f4ac79b72c8f95',ramdisk_id='',reservation_id='r-u9hr9b5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1364765065',owner_user_name='tempest-ServerActionsTestOtherA-1364765065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:33:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d7605635edc4cf9bddad897b8c18b77',uuid=f289e23f-cab7-4631-9c80-6b0391bbea89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converting VIF {"id": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "address": "fa:16:3e:20:c7:3a", "network": {"id": "908e7e66-59f0-44ab-b675-157090484db1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1505262196-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4449c61c4f64b2f96f4ac79b72c8f95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504064ac-20", "ovs_interfaceid": "504064ac-206b-4ceb-9eb0-e87b8bfee408", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:c7:3a,bridge_name='br-int',has_traffic_filtering=True,id=504064ac-206b-4ceb-9eb0-e87b8bfee408,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504064ac-20') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG os_vif [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:c7:3a,bridge_name='br-int',has_traffic_filtering=True,id=504064ac-206b-4ceb-9eb0-e87b8bfee408,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504064ac-20') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap504064ac-20, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1dd9179e-9cc3-4e2e-b389-c8968a95eaca) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:16 user nova-compute[74241]: INFO os_vif [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:c7:3a,bridge_name='br-int',has_traffic_filtering=True,id=504064ac-206b-4ceb-9eb0-e87b8bfee408,network=Network(908e7e66-59f0-44ab-b675-157090484db1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504064ac-20')
Oct 20 11:54:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Deleting instance files /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89_del
Oct 20 11:54:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Deletion of /opt/stack/data/nova/instances/f289e23f-cab7-4631-9c80-6b0391bbea89_del complete
Oct 20 11:54:16 user nova-compute[74241]: INFO nova.compute.manager [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 11:54:16 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:54:16 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:54:17 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:54:17 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Took 1.03 seconds to deallocate network for instance.
Oct 20 11:54:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-cdc05bc6-fbfa-4be9-b5d6-2634d5c0dc01 req-f5d407a3-c775-42f3-badb-707a001edf91 service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-vif-deleted-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 11:54:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 11:54:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 11:54:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 11:54:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 11:54:18 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:54:18 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:54:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-c40117da-6cf7-4088-9f67-b61f8a81b50e req-6f60ecf0-aea0-49ea-9095-c0fbc8f7071b service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received event network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c40117da-6cf7-4088-9f67-b61f8a81b50e req-6f60ecf0-aea0-49ea-9095-c0fbc8f7071b service nova] Acquiring lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c40117da-6cf7-4088-9f67-b61f8a81b50e req-6f60ecf0-aea0-49ea-9095-c0fbc8f7071b service nova] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c40117da-6cf7-4088-9f67-b61f8a81b50e req-6f60ecf0-aea0-49ea-9095-c0fbc8f7071b service nova] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-c40117da-6cf7-4088-9f67-b61f8a81b50e req-6f60ecf0-aea0-49ea-9095-c0fbc8f7071b service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] No waiting events found dispatching network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:18 user nova-compute[74241]: WARNING nova.compute.manager [req-c40117da-6cf7-4088-9f67-b61f8a81b50e req-6f60ecf0-aea0-49ea-9095-c0fbc8f7071b service nova] [instance: f289e23f-cab7-4631-9c80-6b0391bbea89] Received unexpected event network-vif-plugged-504064ac-206b-4ceb-9eb0-e87b8bfee408 for instance with vm_state deleted and task_state None.
Oct 20 11:54:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:18 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Deleted allocations for instance f289e23f-cab7-4631-9c80-6b0391bbea89
Oct 20 11:54:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7b899fd7-21e9-4002-8c7e-c500b34a99fa tempest-ServerActionsTestOtherA-1364765065 tempest-ServerActionsTestOtherA-1364765065-project-member] Lock "f289e23f-cab7-4631-9c80-6b0391bbea89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:54:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:54:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:54:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:54:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:54:32 user nova-compute[74241]: INFO nova.compute.manager [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Rescuing
Oct 20 11:54:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:54:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquired lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:54:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating instance_info_cache with network_info: [{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Releasing lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-aed29e2a-07c7-4ad7-8298-7a32a45ad10a req-77570d70-3466-4699-a12c-9cfe5f08e7f3 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aed29e2a-07c7-4ad7-8298-7a32a45ad10a req-77570d70-3466-4699-a12c-9cfe5f08e7f3 service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aed29e2a-07c7-4ad7-8298-7a32a45ad10a req-77570d70-3466-4699-a12c-9cfe5f08e7f3 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aed29e2a-07c7-4ad7-8298-7a32a45ad10a req-77570d70-3466-4699-a12c-9cfe5f08e7f3 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-aed29e2a-07c7-4ad7-8298-7a32a45ad10a req-77570d70-3466-4699-a12c-9cfe5f08e7f3 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:33 user nova-compute[74241]: WARNING nova.compute.manager [req-aed29e2a-07c7-4ad7-8298-7a32a45ad10a req-77570d70-3466-4699-a12c-9cfe5f08e7f3 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state active and task_state rescuing.
Oct 20 11:54:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance destroyed successfully.
Oct 20 11:54:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Attempting a stable device rescue
Oct 20 11:54:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 11:54:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance directory exists: not creating {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 11:54:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Creating image(s)
Oct 20 11:54:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "/opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "/opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:34 user nova-compute[74241]: DEBUG nova.objects.instance [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG nova.virt.images [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] 6414e260-3ffb-48f3-a392-8fb8abaf2207 was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6.part /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG nova.compute.manager [req-2feb85ff-f886-4286-be36-130ae52c7016 req-9a247d93-6175-47c1-9a70-334e23c12005 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2feb85ff-f886-4286-be36-130ae52c7016 req-9a247d93-6175-47c1-9a70-334e23c12005 service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2feb85ff-f886-4286-be36-130ae52c7016 req-9a247d93-6175-47c1-9a70-334e23c12005 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2feb85ff-f886-4286-be36-130ae52c7016 req-9a247d93-6175-47c1-9a70-334e23c12005 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:35 user nova-compute[74241]: DEBUG nova.compute.manager [req-2feb85ff-f886-4286-be36-130ae52c7016 req-9a247d93-6175-47c1-9a70-334e23c12005 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:35 user nova-compute[74241]: WARNING nova.compute.manager [req-2feb85ff-f886-4286-be36-130ae52c7016 req-9a247d93-6175-47c1-9a70-334e23c12005 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state active and task_state rescuing.
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6.part /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6.converted" returned: 0 in 0.752s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.148s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6 --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6,backing_fmt=raw /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6,backing_fmt=raw /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue" returned: 0 in 0.047s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.instance [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'migration_context' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<9ab397f5-6d89-4bc6-b1e5-10cb423f5f91> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Start _get_guest_xml network_info=[{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "vif_mac": "fa:16:3e:44:a7:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6414e260-3ffb-48f3-a392-8fb8abaf2207', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '5d9b0b05-88c8-48d0-a760-f2166c366b0c', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSpvcYWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9ab397f5-6d89-4bc6-b1e5-10cb423f5f91', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'serial': 'ae6c9492-d5a5-4f68-b809-4a50aec8c6c7'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.instance [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'resources' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<9ab397f5-6d89-4bc6-b1e5-10cb423f5f91> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.instance [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<9ab397f5-6d89-4bc6-b1e5-10cb423f5f91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:54:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:54:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.instance [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<9ab397f5-6d89-4bc6-b1e5-10cb423f5f91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSpvcYWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:54:36 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:54:36 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:54:36 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9dc6b9-8355-4242-b082-802ec23876ec]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oSpvcYWX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 11:54:36 user nova-compute[74241]: node.name = iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:54:36 user nova-compute[74241]: node.tpgt = -1
Oct 20 11:54:36 user nova-compute[74241]: node.startup = automatic
Oct 20 11:54:36 user nova-compute[74241]: node.leading_login = No
Oct 20 11:54:36 user nova-compute[74241]: iface.iscsi_ifacename = default
Oct 20 11:54:36 user nova-compute[74241]: iface.net_ifacename = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.ipaddress = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.prefix_len = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.hwaddress = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.transport_name = tcp
Oct 20 11:54:36 user nova-compute[74241]: iface.initiatorname = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.state = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.vlan_id = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.vlan_priority = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.vlan_state = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.iface_num = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.mtu = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.port = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.bootproto = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.subnet_mask = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.gateway = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.dhcp_alt_client_id = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.dhcp_dns = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.dhcp_learn_iqn = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.dhcp_vendor_id_state = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.dhcp_vendor_id = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.dhcp_slp_da = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.fragmentation = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.gratuitous_arp = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.incoming_forwarding = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.tos_state = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.tos = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.ttl = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.delayed_ack = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.tcp_nagle = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.tcp_wsf_state = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.tcp_wsf = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.tcp_timer_scale = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.tcp_timestamp = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.redirect = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.def_task_mgmt_timeout = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.header_digest = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.data_digest = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.immediate_data = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.initial_r2t = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.data_seq_inorder = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.data_pdu_inorder = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.erl = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.max_receive_data_len = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.first_burst_len = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.max_outstanding_r2t = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.max_burst_len = 0
Oct 20 11:54:36 user nova-compute[74241]: iface.chap_auth = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.bidi_chap = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.strict_login_compliance = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.discovery_auth = <empty>
Oct 20 11:54:36 user nova-compute[74241]: iface.discovery_logout = <empty>
Oct 20 11:54:36 user nova-compute[74241]: node.discovery_address = <empty>
Oct 20 11:54:36 user nova-compute[74241]: node.discovery_port = 0
Oct 20 11:54:36 user nova-compute[74241]: node.discovery_type = static
Oct 20 11:54:36 user nova-compute[74241]: node.session.initial_cmdsn = 0
Oct 20 11:54:36 user nova-compute[74241]: node.session.initial_login_retry_max = 8
Oct 20 11:54:36 user nova-compute[74241]: node.session.xmit_thread_priority = -20
Oct 20 11:54:36 user nova-compute[74241]: node.session.cmds_max = 128
Oct 20 11:54:36 user nova-compute[74241]: node.session.queue_depth = 32
Oct 20 11:54:36 user nova-compute[74241]: node.session.nr_sessions = 1
Oct 20 11:54:36 user nova-compute[74241]: node.session.auth.authmethod = CHAP
Oct 20 11:54:36 user nova-compute[74241]: node.session.auth.username = oSpvcYWX
Oct 20 11:54:36 user nova-compute[74241]: node.session.auth.password = ***
Oct 20 11:54:36 user nova-compute[74241]: node.session.auth.username_in = <empty>
Oct 20 11:54:36 user nova-compute[74241]: node.session.auth.password_in = <empty>
Oct 20 11:54:36 user nova-compute[74241]: node.session.auth.chap_algs = MD5
Oct 20 11:54:36 user nova-compute[74241]: node.session.timeo.replacement_timeout = 120
Oct 20 11:54:36 user nova-compute[74241]: node.session.err_timeo.abort_timeout = 15
Oct 20 11:54:36 user nova-compute[74241]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 11:54:36 user nova-compute[74241]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 11:54:36 user nova-compute[74241]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.FastAbort = Yes
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.InitialR2T = No
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.ImmediateData = Yes
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.MaxConnections = 1
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 11:54:36 user nova-compute[74241]: node.session.iscsi.ERL = 0
Oct 20 11:54:36 user nova-compute[74241]: node.session.scan = manual
Oct 20 11:54:36 user nova-compute[74241]: node.session.reopen_max = 0
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].address = 172.16.0.220
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].port = 3260
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].startup = manual
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].tcp.window_size = 524288
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].tcp.type_of_service = 0
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].timeo.logout_timeout = 15
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].timeo.login_timeout = 15
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].timeo.auth_timeout = 45
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].iscsi.DataDigest = None
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].iscsi.IFMarker = No
Oct 20 11:54:36 user nova-compute[74241]: node.conn[0].iscsi.OFMarker = No
Oct 20 11:54:36 user nova-compute[74241]: # END RECORD
Oct 20 11:54:36 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[db17c4d4-0a4c-4c98-a8af-a58190c06fcb]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb0c9db-4809-4c3b-a7cd-eba051ec868c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSpvcYWX {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSpvcYWX" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7e5b36-34ba-445f-b072-74a4d91ea117]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oSpvcYWX'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc89f63-a265-4217-905c-a522661bffad]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fe0501-e2d4-4b08-8463-33a54d153b47]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:54:36 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:54:36 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:54:36 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:54:36 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] HCTL ('35', '0', '0', 0) found on session 34 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e9987a-c694-40a0-bdfd-5d5e61d970bd]: (4, ('0 0 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching for a device in session 34 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSpvcYWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26537346132626435', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537346132626435', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-822068380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-822068380',id=32,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:53:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-d71hdc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:53:29Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=9ab397f5-6d89-4bc6-b1e5-10cb423f5f91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "vif_mac": "fa:16:3e:44:a7:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "vif_mac": "fa:16:3e:44:a7:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:a7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8cd19fc4-d5a2-429e-a495-de7e92ccb893,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd19fc4-d5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.instance [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.objects.base [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<9ab397f5-6d89-4bc6-b1e5-10cb423f5f91> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 11:54:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:54:36 user nova-compute[74241]:   <uuid>9ab397f5-6d89-4bc6-b1e5-10cb423f5f91</uuid>
Oct 20 11:54:36 user nova-compute[74241]:   <name>instance-00000020</name>
Oct 20 11:54:36 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:54:36 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:54:36 user nova-compute[74241]:   <metadata>
Oct 20 11:54:36 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:54:36 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:54:36 user nova-compute[74241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-822068380</nova:name>
Oct 20 11:54:36 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:54:36</nova:creationTime>
Oct 20 11:54:36 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:54:36 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:54:36 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:54:36 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:54:36 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:54:36 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:54:36 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:54:36 user nova-compute[74241]:       <nova:owner>
Oct 20 11:54:36 user nova-compute[74241]:         <nova:user uuid="0c611c28a9264820a26f203045040420">tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member</nova:user>
Oct 20 11:54:36 user nova-compute[74241]:         <nova:project uuid="52f8151a0cf44b2d89838da474c2dc68">tempest-ServerBootFromVolumeStableRescueTest-929360393</nova:project>
Oct 20 11:54:36 user nova-compute[74241]:       </nova:owner>
Oct 20 11:54:36 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:54:36 user nova-compute[74241]:       <nova:ports>
Oct 20 11:54:36 user nova-compute[74241]:         <nova:port uuid="8cd19fc4-d5a2-429e-a495-de7e92ccb893">
Oct 20 11:54:36 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 11:54:36 user nova-compute[74241]:         </nova:port>
Oct 20 11:54:36 user nova-compute[74241]:       </nova:ports>
Oct 20 11:54:36 user nova-compute[74241]:     </nova:instance>
Oct 20 11:54:36 user nova-compute[74241]:   </metadata>
Oct 20 11:54:36 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:54:36 user nova-compute[74241]:     <system>
Oct 20 11:54:36 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:54:36 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:54:36 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:54:36 user nova-compute[74241]:       <entry name="serial">9ab397f5-6d89-4bc6-b1e5-10cb423f5f91</entry>
Oct 20 11:54:36 user nova-compute[74241]:       <entry name="uuid">9ab397f5-6d89-4bc6-b1e5-10cb423f5f91</entry>
Oct 20 11:54:36 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:54:36 user nova-compute[74241]:     </system>
Oct 20 11:54:36 user nova-compute[74241]:   </sysinfo>
Oct 20 11:54:36 user nova-compute[74241]:   <os>
Oct 20 11:54:36 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:54:36 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:54:36 user nova-compute[74241]:   </os>
Oct 20 11:54:36 user nova-compute[74241]:   <features>
Oct 20 11:54:36 user nova-compute[74241]:     <acpi/>
Oct 20 11:54:36 user nova-compute[74241]:     <apic/>
Oct 20 11:54:36 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:54:36 user nova-compute[74241]:   </features>
Oct 20 11:54:36 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:54:36 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:54:36 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:54:36 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:54:36 user nova-compute[74241]:   </clock>
Oct 20 11:54:36 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:54:36 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:54:36 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:54:36 user nova-compute[74241]:   </cpu>
Oct 20 11:54:36 user nova-compute[74241]:   <devices>
Oct 20 11:54:36 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 11:54:36 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:54:36 user nova-compute[74241]:       <source dev="/dev/sdd"/>
Oct 20 11:54:36 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:54:36 user nova-compute[74241]:       <serial>ae6c9492-d5a5-4f68-b809-4a50aec8c6c7</serial>
Oct 20 11:54:36 user nova-compute[74241]:     </disk>
Oct 20 11:54:36 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:54:36 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:54:36 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue"/>
Oct 20 11:54:36 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 11:54:36 user nova-compute[74241]:       <boot order="1"/>
Oct 20 11:54:36 user nova-compute[74241]:     </disk>
Oct 20 11:54:36 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:54:36 user nova-compute[74241]:       <mac address="fa:16:3e:44:a7:8a"/>
Oct 20 11:54:36 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:54:36 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:54:36 user nova-compute[74241]:       <target dev="tap8cd19fc4-d5"/>
Oct 20 11:54:36 user nova-compute[74241]:     </interface>
Oct 20 11:54:36 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:54:36 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/console.log" append="off"/>
Oct 20 11:54:36 user nova-compute[74241]:     </serial>
Oct 20 11:54:36 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:54:36 user nova-compute[74241]:     <video>
Oct 20 11:54:36 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:54:36 user nova-compute[74241]:     </video>
Oct 20 11:54:36 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:54:36 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:54:36 user nova-compute[74241]:     </rng>
Oct 20 11:54:36 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:54:36 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:54:36 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:54:36 user nova-compute[74241]:     </memballoon>
Oct 20 11:54:36 user nova-compute[74241]:   </devices>
Oct 20 11:54:36 user nova-compute[74241]: </domain>
Oct 20 11:54:36 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:54:36 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance destroyed successfully.
Oct 20 11:54:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:54:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:54:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No VIF found with MAC fa:16:3e:44:a7:8a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-7438d21c-5def-480e-809f-ac8a39a7da29 req-92dac7b0-8d72-46fe-9993-a02d3a7fe488 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7438d21c-5def-480e-809f-ac8a39a7da29 req-92dac7b0-8d72-46fe-9993-a02d3a7fe488 service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7438d21c-5def-480e-809f-ac8a39a7da29 req-92dac7b0-8d72-46fe-9993-a02d3a7fe488 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7438d21c-5def-480e-809f-ac8a39a7da29 req-92dac7b0-8d72-46fe-9993-a02d3a7fe488 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-7438d21c-5def-480e-809f-ac8a39a7da29 req-92dac7b0-8d72-46fe-9993-a02d3a7fe488 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:38 user nova-compute[74241]: WARNING nova.compute.manager [req-7438d21c-5def-480e-809f-ac8a39a7da29 req-92dac7b0-8d72-46fe-9993-a02d3a7fe488 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state active and task_state rescuing.
Oct 20 11:54:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:54:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:39 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:54:39 user nova-compute[74241]: INFO nova.compute.claims [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Claim successful on node user
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.network.neutron [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:54:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.policy [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f1fe587313141b488e5975c3e72c571', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4764e42940fd415986f661c0abfe5e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:54:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Creating image(s)
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "/opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "/opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "/opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-26d72955-eb8a-4cd7-a15c-942823c6655c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.218s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-273d3da7-2e4e-43a2-b80e-397bf55b293d req-530f2919-69b3-4dbf-9aae-8f88821e44ca service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-273d3da7-2e4e-43a2-b80e-397bf55b293d req-530f2919-69b3-4dbf-9aae-8f88821e44ca service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-273d3da7-2e4e-43a2-b80e-397bf55b293d req-530f2919-69b3-4dbf-9aae-8f88821e44ca service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-273d3da7-2e4e-43a2-b80e-397bf55b293d req-530f2919-69b3-4dbf-9aae-8f88821e44ca service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-273d3da7-2e4e-43a2-b80e-397bf55b293d req-530f2919-69b3-4dbf-9aae-8f88821e44ca service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:40 user nova-compute[74241]: WARNING nova.compute.manager [req-273d3da7-2e4e-43a2-b80e-397bf55b293d req-530f2919-69b3-4dbf-9aae-8f88821e44ca service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state rescued and task_state None.
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk 1073741824" returned: 0 in 0.054s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG nova.network.neutron [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Successfully created port: 6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Checking if we can resize image /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Cannot resize image /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Ensure instance console log exists: /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:41 user nova-compute[74241]: DEBUG nova.network.neutron [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Successfully updated port: 6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquired lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f955f8f-c398-4310-811a-f2c678e885d8 req-2ff40776-c1d2-446d-b45c-4b9e0a145d53 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received event network-changed-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f955f8f-c398-4310-811a-f2c678e885d8 req-2ff40776-c1d2-446d-b45c-4b9e0a145d53 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Refreshing instance network info cache due to event network-changed-6671c30e-b5a1-4079-b5a6-d9a1df748a54. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f955f8f-c398-4310-811a-f2c678e885d8 req-2ff40776-c1d2-446d-b45c-4b9e0a145d53 service nova] Acquiring lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Updating instance_info_cache with network_info: [{"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Releasing lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Instance network_info: |[{"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f955f8f-c398-4310-811a-f2c678e885d8 req-2ff40776-c1d2-446d-b45c-4b9e0a145d53 service nova] Acquired lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-3f955f8f-c398-4310-811a-f2c678e885d8 req-2ff40776-c1d2-446d-b45c-4b9e0a145d53 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Refreshing network info cache for port 6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Start _get_guest_xml network_info=[{"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:54:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:54:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-298331357',display_name='tempest-VolumesSnapshotTestJSON-instance-298331357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-298331357',id=35,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZ8/oWLiEGEaMy88eZK7OfbmbJkz1Snyy1oend+H0zgs1LNCPDH4LNLtkspA2aFWwRBO8MFykQKkAEbLfXH2WMSxr8xtSehI5ln2VxEPG4ZTblNF9g84oCXye1ztUDo/Q==',key_name='tempest-keypair-72918536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4764e42940fd415986f661c0abfe5e5b',ramdisk_id='',reservation_id='r-5vjcmixi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-740119974',owner_user_name='tempest-VolumesSnapshotTestJSON-740119974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f1fe587313141b488e5975c3e72c571',uuid=600dfdc0-0486-47bc-aeba-be1ae265462f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converting VIF {"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:4d:a6,bridge_name='br-int',has_traffic_filtering=True,id=6671c30e-b5a1-4079-b5a6-d9a1df748a54,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6671c30e-b5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.objects.instance [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'pci_devices' on Instance uuid 600dfdc0-0486-47bc-aeba-be1ae265462f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:54:42 user nova-compute[74241]:   <uuid>600dfdc0-0486-47bc-aeba-be1ae265462f</uuid>
Oct 20 11:54:42 user nova-compute[74241]:   <name>instance-00000023</name>
Oct 20 11:54:42 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:54:42 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:54:42 user nova-compute[74241]:   <metadata>
Oct 20 11:54:42 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:54:42 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:54:42 user nova-compute[74241]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-298331357</nova:name>
Oct 20 11:54:42 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:54:42</nova:creationTime>
Oct 20 11:54:42 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:54:42 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:54:42 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:54:42 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:54:42 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:54:42 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:54:42 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:54:42 user nova-compute[74241]:       <nova:owner>
Oct 20 11:54:42 user nova-compute[74241]:         <nova:user uuid="4f1fe587313141b488e5975c3e72c571">tempest-VolumesSnapshotTestJSON-740119974-project-member</nova:user>
Oct 20 11:54:42 user nova-compute[74241]:         <nova:project uuid="4764e42940fd415986f661c0abfe5e5b">tempest-VolumesSnapshotTestJSON-740119974</nova:project>
Oct 20 11:54:42 user nova-compute[74241]:       </nova:owner>
Oct 20 11:54:42 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:54:42 user nova-compute[74241]:       <nova:ports>
Oct 20 11:54:42 user nova-compute[74241]:         <nova:port uuid="6671c30e-b5a1-4079-b5a6-d9a1df748a54">
Oct 20 11:54:42 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 11:54:42 user nova-compute[74241]:         </nova:port>
Oct 20 11:54:42 user nova-compute[74241]:       </nova:ports>
Oct 20 11:54:42 user nova-compute[74241]:     </nova:instance>
Oct 20 11:54:42 user nova-compute[74241]:   </metadata>
Oct 20 11:54:42 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:54:42 user nova-compute[74241]:     <system>
Oct 20 11:54:42 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:54:42 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:54:42 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:54:42 user nova-compute[74241]:       <entry name="serial">600dfdc0-0486-47bc-aeba-be1ae265462f</entry>
Oct 20 11:54:42 user nova-compute[74241]:       <entry name="uuid">600dfdc0-0486-47bc-aeba-be1ae265462f</entry>
Oct 20 11:54:42 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:54:42 user nova-compute[74241]:     </system>
Oct 20 11:54:42 user nova-compute[74241]:   </sysinfo>
Oct 20 11:54:42 user nova-compute[74241]:   <os>
Oct 20 11:54:42 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:54:42 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:54:42 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:54:42 user nova-compute[74241]:   </os>
Oct 20 11:54:42 user nova-compute[74241]:   <features>
Oct 20 11:54:42 user nova-compute[74241]:     <acpi/>
Oct 20 11:54:42 user nova-compute[74241]:     <apic/>
Oct 20 11:54:42 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:54:42 user nova-compute[74241]:   </features>
Oct 20 11:54:42 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:54:42 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:54:42 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:54:42 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:54:42 user nova-compute[74241]:   </clock>
Oct 20 11:54:42 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:54:42 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:54:42 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:54:42 user nova-compute[74241]:   </cpu>
Oct 20 11:54:42 user nova-compute[74241]:   <devices>
Oct 20 11:54:42 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:54:42 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:54:42 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk"/>
Oct 20 11:54:42 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:54:42 user nova-compute[74241]:     </disk>
Oct 20 11:54:42 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:54:42 user nova-compute[74241]:       <mac address="fa:16:3e:31:4d:a6"/>
Oct 20 11:54:42 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:54:42 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:54:42 user nova-compute[74241]:       <target dev="tap6671c30e-b5"/>
Oct 20 11:54:42 user nova-compute[74241]:     </interface>
Oct 20 11:54:42 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:54:42 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/console.log" append="off"/>
Oct 20 11:54:42 user nova-compute[74241]:     </serial>
Oct 20 11:54:42 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:54:42 user nova-compute[74241]:     <video>
Oct 20 11:54:42 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:54:42 user nova-compute[74241]:     </video>
Oct 20 11:54:42 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:54:42 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:54:42 user nova-compute[74241]:     </rng>
Oct 20 11:54:42 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:54:42 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:54:42 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:54:42 user nova-compute[74241]:     </memballoon>
Oct 20 11:54:42 user nova-compute[74241]:   </devices>
Oct 20 11:54:42 user nova-compute[74241]: </domain>
Oct 20 11:54:42 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-298331357',display_name='tempest-VolumesSnapshotTestJSON-instance-298331357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-298331357',id=35,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZ8/oWLiEGEaMy88eZK7OfbmbJkz1Snyy1oend+H0zgs1LNCPDH4LNLtkspA2aFWwRBO8MFykQKkAEbLfXH2WMSxr8xtSehI5ln2VxEPG4ZTblNF9g84oCXye1ztUDo/Q==',key_name='tempest-keypair-72918536',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4764e42940fd415986f661c0abfe5e5b',ramdisk_id='',reservation_id='r-5vjcmixi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-740119974',owner_user_name='tempest-VolumesSnapshotTestJSON-740119974-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f1fe587313141b488e5975c3e72c571',uuid=600dfdc0-0486-47bc-aeba-be1ae265462f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converting VIF {"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:4d:a6,bridge_name='br-int',has_traffic_filtering=True,id=6671c30e-b5a1-4079-b5a6-d9a1df748a54,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6671c30e-b5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG os_vif [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:4d:a6,bridge_name='br-int',has_traffic_filtering=True,id=6671c30e-b5a1-4079-b5a6-d9a1df748a54,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6671c30e-b5') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5030790-fec5-5dfe-b8d5-e7bf7913a6b8', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6671c30e-b5, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6671c30e-b5, col_values=(('qos', UUID('ffafcd1e-944c-45b9-9b63-b2c607c7e278')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6671c30e-b5, col_values=(('external_ids', {'iface-id': '6671c30e-b5a1-4079-b5a6-d9a1df748a54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:4d:a6', 'vm-uuid': '600dfdc0-0486-47bc-aeba-be1ae265462f'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:42 user nova-compute[74241]: INFO os_vif [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:4d:a6,bridge_name='br-int',has_traffic_filtering=True,id=6671c30e-b5a1-4079-b5a6-d9a1df748a54,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6671c30e-b5')
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No VIF found with MAC fa:16:3e:31:4d:a6, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-3f955f8f-c398-4310-811a-f2c678e885d8 req-2ff40776-c1d2-446d-b45c-4b9e0a145d53 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Updated VIF entry in instance network info cache for port 6671c30e-b5a1-4079-b5a6-d9a1df748a54. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-3f955f8f-c398-4310-811a-f2c678e885d8 req-2ff40776-c1d2-446d-b45c-4b9e0a145d53 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Updating instance_info_cache with network_info: [{"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:54:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f955f8f-c398-4310-811a-f2c678e885d8 req-2ff40776-c1d2-446d-b45c-4b9e0a145d53 service nova] Releasing lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:54:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-3acbe3c0-8b6a-4e1a-9bbb-2454bdbe3384 req-ee6fd84c-4487-4045-9f64-087c336aaaf2 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received event network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3acbe3c0-8b6a-4e1a-9bbb-2454bdbe3384 req-ee6fd84c-4487-4045-9f64-087c336aaaf2 service nova] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3acbe3c0-8b6a-4e1a-9bbb-2454bdbe3384 req-ee6fd84c-4487-4045-9f64-087c336aaaf2 service nova] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3acbe3c0-8b6a-4e1a-9bbb-2454bdbe3384 req-ee6fd84c-4487-4045-9f64-087c336aaaf2 service nova] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-3acbe3c0-8b6a-4e1a-9bbb-2454bdbe3384 req-ee6fd84c-4487-4045-9f64-087c336aaaf2 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] No waiting events found dispatching network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:44 user nova-compute[74241]: WARNING nova.compute.manager [req-3acbe3c0-8b6a-4e1a-9bbb-2454bdbe3384 req-ee6fd84c-4487-4045-9f64-087c336aaaf2 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received unexpected event network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 for instance with vm_state building and task_state spawning.
Oct 20 11:54:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-ed562492-c91c-46d2-b177-4beac6fcfa55 req-7382ffb7-e9e8-4f4a-adae-e984dea05671 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received event network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed562492-c91c-46d2-b177-4beac6fcfa55 req-7382ffb7-e9e8-4f4a-adae-e984dea05671 service nova] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed562492-c91c-46d2-b177-4beac6fcfa55 req-7382ffb7-e9e8-4f4a-adae-e984dea05671 service nova] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed562492-c91c-46d2-b177-4beac6fcfa55 req-7382ffb7-e9e8-4f4a-adae-e984dea05671 service nova] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-ed562492-c91c-46d2-b177-4beac6fcfa55 req-7382ffb7-e9e8-4f4a-adae-e984dea05671 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] No waiting events found dispatching network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:46 user nova-compute[74241]: WARNING nova.compute.manager [req-ed562492-c91c-46d2-b177-4beac6fcfa55 req-7382ffb7-e9e8-4f4a-adae-e984dea05671 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received unexpected event network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 for instance with vm_state building and task_state spawning.
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:54:46 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Instance spawned successfully.
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:54:46 user nova-compute[74241]: INFO nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Took 5.94 seconds to spawn the instance on the hypervisor.
Oct 20 11:54:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:54:46 user nova-compute[74241]: INFO nova.compute.manager [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Took 6.71 seconds to build instance.
Oct 20 11:54:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-68f24617-2992-4d8b-a39c-d4e9b7219e95 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.817s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "d24bf60b-6e03-4708-a615-1a2b42869cfe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:47 user nova-compute[74241]: INFO nova.compute.manager [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Terminating instance
Oct 20 11:54:47 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-bbf98cbb-1b64-49f7-9156-ac1e6417f1ca req-c3f6d44b-d46a-4bd5-b3fc-74e19a768df9 service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received event network-vif-unplugged-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bbf98cbb-1b64-49f7-9156-ac1e6417f1ca req-c3f6d44b-d46a-4bd5-b3fc-74e19a768df9 service nova] Acquiring lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bbf98cbb-1b64-49f7-9156-ac1e6417f1ca req-c3f6d44b-d46a-4bd5-b3fc-74e19a768df9 service nova] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bbf98cbb-1b64-49f7-9156-ac1e6417f1ca req-c3f6d44b-d46a-4bd5-b3fc-74e19a768df9 service nova] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-bbf98cbb-1b64-49f7-9156-ac1e6417f1ca req-c3f6d44b-d46a-4bd5-b3fc-74e19a768df9 service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] No waiting events found dispatching network-vif-unplugged-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-bbf98cbb-1b64-49f7-9156-ac1e6417f1ca req-c3f6d44b-d46a-4bd5-b3fc-74e19a768df9 service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received event network-vif-unplugged-181cea76-6b32-4a31-be53-657815fcaf95 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:54:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Instance destroyed successfully.
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lazy-loading 'resources' on Instance uuid d24bf60b-6e03-4708-a615-1a2b42869cfe {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:52:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1591118686',display_name='tempest-VolumesActionsTest-instance-1591118686',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1591118686',id=33,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:53:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='191f0dcc776c4b39854429de2da2f6b6',ramdisk_id='',reservation_id='r-299h0d98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-742523305',owner_user_name='tempest-VolumesActionsTest-742523305-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:53:03Z,user_data=None,user_id='ff4914c45f8d42769609be5b8efac117',uuid=d24bf60b-6e03-4708-a615-1a2b42869cfe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converting VIF {"id": "181cea76-6b32-4a31-be53-657815fcaf95", "address": "fa:16:3e:8f:ea:cd", "network": {"id": "1284a484-7b86-49f7-9dd1-0bcf3e10a252", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1491026186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "191f0dcc776c4b39854429de2da2f6b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap181cea76-6b", "ovs_interfaceid": "181cea76-6b32-4a31-be53-657815fcaf95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:cd,bridge_name='br-int',has_traffic_filtering=True,id=181cea76-6b32-4a31-be53-657815fcaf95,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181cea76-6b') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG os_vif [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:cd,bridge_name='br-int',has_traffic_filtering=True,id=181cea76-6b32-4a31-be53-657815fcaf95,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181cea76-6b') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap181cea76-6b, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9cd79d3f-3449-4906-bf72-910b100fc251) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:48 user nova-compute[74241]: INFO os_vif [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ea:cd,bridge_name='br-int',has_traffic_filtering=True,id=181cea76-6b32-4a31-be53-657815fcaf95,network=Network(1284a484-7b86-49f7-9dd1-0bcf3e10a252),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap181cea76-6b')
Oct 20 11:54:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Deleting instance files /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe_del
Oct 20 11:54:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Deletion of /opt/stack/data/nova/instances/d24bf60b-6e03-4708-a615-1a2b42869cfe_del complete
Oct 20 11:54:48 user nova-compute[74241]: INFO nova.compute.manager [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 11:54:48 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:54:48 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Took 0.59 seconds to deallocate network for instance.
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-221a13e0-f56b-492d-8ba7-deb24803eb9f req-96f4ba0b-91ee-4229-9b1f-f2dc1854951f service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received event network-vif-deleted-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:48 user nova-compute[74241]: INFO nova.compute.manager [req-221a13e0-f56b-492d-8ba7-deb24803eb9f req-96f4ba0b-91ee-4229-9b1f-f2dc1854951f service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Neutron deleted interface 181cea76-6b32-4a31-be53-657815fcaf95; detaching it from the instance and deleting it from the info cache
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.network.neutron [req-221a13e0-f56b-492d-8ba7-deb24803eb9f req-96f4ba0b-91ee-4229-9b1f-f2dc1854951f service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-221a13e0-f56b-492d-8ba7-deb24803eb9f req-96f4ba0b-91ee-4229-9b1f-f2dc1854951f service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Detach interface failed, port_id=181cea76-6b32-4a31-be53-657815fcaf95, reason: Instance d24bf60b-6e03-4708-a615-1a2b42869cfe could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:49 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:54:49 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:54:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:49 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Deleted allocations for instance d24bf60b-6e03-4708-a615-1a2b42869cfe
Oct 20 11:54:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6be6e4c1-43b3-45ed-9b48-a189bfda1cf5 tempest-VolumesActionsTest-742523305 tempest-VolumesActionsTest-742523305-project-member] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-2340eecf-7e8a-432f-8f4f-b63c907647c9 req-55069c8e-3c56-47ef-aabc-f64ba4a0dcba service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received event network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2340eecf-7e8a-432f-8f4f-b63c907647c9 req-55069c8e-3c56-47ef-aabc-f64ba4a0dcba service nova] Acquiring lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2340eecf-7e8a-432f-8f4f-b63c907647c9 req-55069c8e-3c56-47ef-aabc-f64ba4a0dcba service nova] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2340eecf-7e8a-432f-8f4f-b63c907647c9 req-55069c8e-3c56-47ef-aabc-f64ba4a0dcba service nova] Lock "d24bf60b-6e03-4708-a615-1a2b42869cfe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-2340eecf-7e8a-432f-8f4f-b63c907647c9 req-55069c8e-3c56-47ef-aabc-f64ba4a0dcba service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] No waiting events found dispatching network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:49 user nova-compute[74241]: WARNING nova.compute.manager [req-2340eecf-7e8a-432f-8f4f-b63c907647c9 req-55069c8e-3c56-47ef-aabc-f64ba4a0dcba service nova] [instance: d24bf60b-6e03-4708-a615-1a2b42869cfe] Received unexpected event network-vif-plugged-181cea76-6b32-4a31-be53-657815fcaf95 for instance with vm_state deleted and task_state None.
Oct 20 11:54:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:53 user nova-compute[74241]: INFO nova.compute.manager [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Terminating instance
Oct 20 11:54:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-23721ca4-b10c-4897-a3eb-7ccb020499b4 req-ce38ca0c-136a-43c6-8251-b41b290665bb service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-unplugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-23721ca4-b10c-4897-a3eb-7ccb020499b4 req-ce38ca0c-136a-43c6-8251-b41b290665bb service nova] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-23721ca4-b10c-4897-a3eb-7ccb020499b4 req-ce38ca0c-136a-43c6-8251-b41b290665bb service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-23721ca4-b10c-4897-a3eb-7ccb020499b4 req-ce38ca0c-136a-43c6-8251-b41b290665bb service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-23721ca4-b10c-4897-a3eb-7ccb020499b4 req-ce38ca0c-136a-43c6-8251-b41b290665bb service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] No waiting events found dispatching network-vif-unplugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-23721ca4-b10c-4897-a3eb-7ccb020499b4 req-ce38ca0c-136a-43c6-8251-b41b290665bb service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-unplugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:54:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Instance destroyed successfully.
Oct 20 11:54:54 user nova-compute[74241]: DEBUG nova.objects.instance [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'resources' on Instance uuid 5b6ea39f-b167-480f-a288-d9bcf55434d2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-25201554',display_name='tempest-TestMinimumBasicScenario-server-25201554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-25201554',id=26,image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeMrMy/sg8XxWtYVyzeFxR7apHfoUn94/bg1fXss/Ic+vdCwCyawATmHr7tQMWjdJcw/9i3eMIb4VHHfQtc1ntaLqNp4C9Dkh99q7CMBGUWZcrFycpxkFPQJHKvbN6R7w==',key_name='tempest-TestMinimumBasicScenario-454614026',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:49:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-rnf101oa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='51d4a3aa-5eba-4773-bb5c-72300483f2dd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:52:08Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=5b6ea39f-b167-480f-a288-d9bcf55434d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "address": "fa:16:3e:54:e1:43", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6096fc9-69", "ovs_interfaceid": "b6096fc9-6928-4d9e-9066-9174bd327ff2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG os_vif [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6096fc9-69, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=513cf096-40ea-4d42-8fc7-5fbbd4a984aa) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:54 user nova-compute[74241]: INFO os_vif [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:e1:43,bridge_name='br-int',has_traffic_filtering=True,id=b6096fc9-6928-4d9e-9066-9174bd327ff2,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6096fc9-69')
Oct 20 11:54:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Deleting instance files /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2_del
Oct 20 11:54:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Deletion of /opt/stack/data/nova/instances/5b6ea39f-b167-480f-a288-d9bcf55434d2_del complete
Oct 20 11:54:54 user nova-compute[74241]: INFO nova.compute.manager [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 11:54:54 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:54:54 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:54:55 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:54:55 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Took 0.47 seconds to deallocate network for instance.
Oct 20 11:54:55 user nova-compute[74241]: DEBUG nova.compute.manager [req-c261d6c8-4efd-4823-b6fa-5de184fddaf4 req-a5bdd7f6-2cae-4d26-921b-b69f35da1264 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-deleted-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:55 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:54:55 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:54:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:55 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Deleted allocations for instance 5b6ea39f-b167-480f-a288-d9bcf55434d2
Oct 20 11:54:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223ffc91-c46b-47c2-b9d7-32ce19000749 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.879s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-ce4d47a4-10f5-4068-921c-5a4d07e13c3a req-6c642ceb-93b8-4c70-b29e-e5944318f307 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:54:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ce4d47a4-10f5-4068-921c-5a4d07e13c3a req-6c642ceb-93b8-4c70-b29e-e5944318f307 service nova] Acquiring lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:54:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ce4d47a4-10f5-4068-921c-5a4d07e13c3a req-6c642ceb-93b8-4c70-b29e-e5944318f307 service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:54:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ce4d47a4-10f5-4068-921c-5a4d07e13c3a req-6c642ceb-93b8-4c70-b29e-e5944318f307 service nova] Lock "5b6ea39f-b167-480f-a288-d9bcf55434d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:54:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-ce4d47a4-10f5-4068-921c-5a4d07e13c3a req-6c642ceb-93b8-4c70-b29e-e5944318f307 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] No waiting events found dispatching network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:54:56 user nova-compute[74241]: WARNING nova.compute.manager [req-ce4d47a4-10f5-4068-921c-5a4d07e13c3a req-6c642ceb-93b8-4c70-b29e-e5944318f307 service nova] [instance: 5b6ea39f-b167-480f-a288-d9bcf55434d2] Received unexpected event network-vif-plugged-b6096fc9-6928-4d9e-9066-9174bd327ff2 for instance with vm_state deleted and task_state None.
Oct 20 11:54:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:54:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:00 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-644ddfb0-34fe-42c4-bbce-00da2f5785a8 req-7a640f75-71e2-4e2b-809e-23cc15d4d922 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-changed-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-644ddfb0-34fe-42c4-bbce-00da2f5785a8 req-7a640f75-71e2-4e2b-809e-23cc15d4d922 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Refreshing instance network info cache due to event network-changed-cc8f8122-a0f6-47f2-9cb4-436a2ba06999. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:55:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-644ddfb0-34fe-42c4-bbce-00da2f5785a8 req-7a640f75-71e2-4e2b-809e-23cc15d4d922 service nova] Acquiring lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:55:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-644ddfb0-34fe-42c4-bbce-00da2f5785a8 req-7a640f75-71e2-4e2b-809e-23cc15d4d922 service nova] Acquired lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:55:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-644ddfb0-34fe-42c4-bbce-00da2f5785a8 req-7a640f75-71e2-4e2b-809e-23cc15d4d922 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Refreshing network info cache for port cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-644ddfb0-34fe-42c4-bbce-00da2f5785a8 req-7a640f75-71e2-4e2b-809e-23cc15d4d922 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updated VIF entry in instance network info cache for port cc8f8122-a0f6-47f2-9cb4-436a2ba06999. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-644ddfb0-34fe-42c4-bbce-00da2f5785a8 req-7a640f75-71e2-4e2b-809e-23cc15d4d922 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updating instance_info_cache with network_info: [{"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-644ddfb0-34fe-42c4-bbce-00da2f5785a8 req-7a640f75-71e2-4e2b-809e-23cc15d4d922 service nova] Releasing lock "refresh_cache-35e53445-2eb7-4f1f-99a7-256e33e442ca" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:55:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:55:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=25.20096206665039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 35e53445-2eb7-4f1f-99a7-256e33e442ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 600dfdc0-0486-47bc-aeba-be1ae265462f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:55:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG nova.objects.instance [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:06 user nova-compute[74241]: INFO nova.compute.manager [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Attaching volume c404d73f-632a-474c-ac55-76cbfa91b9b2 to /dev/vdb
Oct 20 11:55:07 user nova-compute[74241]: DEBUG os_brick.utils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[62af844a-6ae8-446d-8d6d-b40d7b684865]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7940d05a-a2b5-45d6-b5f8-b21a866e5706]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b1989-5bc4-42ee-be93-fca08af07cfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbbc0f8-1d58-4640-9463-5ff7095b2551]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:55:07 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32f564-2d46-46e2-8f10-cbda1e1ad17e]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG os_brick.utils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updating existing volume attachment record: 7bedaf4e-3e89-40be-88c7-eda3519a6efd {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:55:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:55:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:55:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:55:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updating instance_info_cache with network_info: [{"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:55:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:55:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:55:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:55:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:16 user nova-compute[74241]: INFO nova.compute.manager [None req-0e40493c-3c56-4289-bc32-40cad663c3d0 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Unrescuing
Oct 20 11:55:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0e40493c-3c56-4289-bc32-40cad663c3d0 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:55:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0e40493c-3c56-4289-bc32-40cad663c3d0 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquired lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:55:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0e40493c-3c56-4289-bc32-40cad663c3d0 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0e40493c-3c56-4289-bc32-40cad663c3d0 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0e40493c-3c56-4289-bc32-40cad663c3d0 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Releasing lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0e40493c-3c56-4289-bc32-40cad663c3d0 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'flavor' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-55523702-8cc1-4066-92a6-2d1f2fedf4eb req-a80ebe16-0825-40d6-ab7a-58d1fcb2d25d service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-55523702-8cc1-4066-92a6-2d1f2fedf4eb req-a80ebe16-0825-40d6-ab7a-58d1fcb2d25d service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-55523702-8cc1-4066-92a6-2d1f2fedf4eb req-a80ebe16-0825-40d6-ab7a-58d1fcb2d25d service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-55523702-8cc1-4066-92a6-2d1f2fedf4eb req-a80ebe16-0825-40d6-ab7a-58d1fcb2d25d service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-55523702-8cc1-4066-92a6-2d1f2fedf4eb req-a80ebe16-0825-40d6-ab7a-58d1fcb2d25d service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:17 user nova-compute[74241]: WARNING nova.compute.manager [req-55523702-8cc1-4066-92a6-2d1f2fedf4eb req-a80ebe16-0825-40d6-ab7a-58d1fcb2d25d service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance destroyed successfully.
Oct 20 11:55:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:19 user nova-compute[74241]: WARNING nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:19 user nova-compute[74241]: WARNING nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:19 user nova-compute[74241]: WARNING nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:19 user nova-compute[74241]: WARNING nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:19 user nova-compute[74241]: WARNING nova.compute.manager [req-af81106e-d71a-43d8-9e9a-3322870c67d5 req-ca8252d1-03d9-4ee9-93d5-a05b7cd3c101 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:55:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:21 user nova-compute[74241]: WARNING nova.compute.manager [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:55:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:21 user nova-compute[74241]: WARNING nova.compute.manager [req-e6180e79-4fce-4a82-a660-e8dc59b87923 req-7c58f2b0-92ba-4803-9dec-79ca5be8c6cb service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:55:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0e40493c-3c56-4289-bc32-40cad663c3d0 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:55:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyFYjPRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:55:26 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:55:26 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:55:26 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4b6fe7-6751-45c3-94ad-ba95ae562566]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:55:26 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa9c422-ef77-4d30-9bf7-2bb3c4c66871]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2] added
Oct 20 11:55:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bdb963-0ac8-4396-9286-ed805a30bf96]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[765edeb5-10be-4d43-b787-d35926cf7d59]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyFYjPRs {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyFYjPRs" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[17452be5-f6e3-4bbb-ac66-f1bbc91c8624]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QyFYjPRs'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a61f742-17ae-45a1-a5cd-0ec09898fc9b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[30648f02-bc4e-44d2-8f2e-95b6397dc153]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:55:26 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:55:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:55:26 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:55:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a008fd8-d33a-4af3-8f81-5c830703b9d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2, portal: 172.16.0.220,3260]
Oct 20 11:55:26 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2, portal: 172.16.0.220,3260] successful.
Oct 20 11:55:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b3c338-f674-4303-ba9e-27b4e5aa41b1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f977bf5-f5d4-40c7-bc13-e8f41b6c17e4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:55:26 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:55:26 user nova-compute[74241]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)
Oct 20 11:55:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:55:26 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:55:26 user nova-compute[74241]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)
Oct 20 11:55:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[13295597-cb3d-4e50-9968-6b37cf22421c]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:55:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyFYjPRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:55:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:55:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23861643964373034', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:55:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861643964373034', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:55:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:55:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:55:27 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:55:27 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:55:27 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:55:27 user nova-compute[74241]:   <serial>c404d73f-632a-474c-ac55-76cbfa91b9b2</serial>
Oct 20 11:55:27 user nova-compute[74241]: </disk>
Oct 20 11:55:27 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:55:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:55:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:55:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No VIF found with MAC fa:16:3e:e8:28:c0, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:55:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-88160027-5af4-4d15-953f-401119cda18e tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.165s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:55:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:55:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:55:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:55:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:34 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:55:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:35 user nova-compute[74241]: INFO nova.compute.manager [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Attaching volume 852f3efc-8851-4c60-8a20-10f388bd5590 to /dev/vdc
Oct 20 11:55:35 user nova-compute[74241]: DEBUG os_brick.utils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8f31f2-3111-4c68-b774-7d0dec908cc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6513f5-3bf3-4bc5-b2f2-66b144f423f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[df654f30-a43d-45f7-b8f2-c9ca200bf3b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22c6a7-9e7f-4f35-9161-19f3aca203a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:55:35 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:55:35 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[169ff836-a81f-44e7-94f2-1c5cc6f039c3]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG os_brick.utils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:55:35 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updating existing volume attachment record: 7c030cc2-9b26-4e62-b7ef-a57f949b40f4 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:55:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:48 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:55:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:55:48 user nova-compute[74241]: INFO nova.compute.claims [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Claim successful on node user
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:55:49 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.policy [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd2b2cd84c5a403f868d69ccc7f8afc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '137870b8216f4a49b1eecde3ec14b75a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:55:49 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Creating image(s)
Oct 20 11:55:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "/opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "/opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "/opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "f3447870663cc21a765ad0f324a9267010b5d22c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "f3447870663cc21a765ad0f324a9267010b5d22c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:50 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Successfully created port: 2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:55:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c.part --force-share --output=json" returned: 0 in 0.211s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:50 user nova-compute[74241]: DEBUG nova.virt.images [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] f4eb7f92-82e1-4927-9b74-f0f6b8dc0206 was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 11:55:50 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 11:55:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c.part /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c.part /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c.converted" returned: 0 in 0.520s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Successfully updated port: 2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquired lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-96480a15-1dba-43eb-b392-d20bc8c9777b req-132a148f-e4b0-4949-9e52-a478f5228c42 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-96480a15-1dba-43eb-b392-d20bc8c9777b req-132a148f-e4b0-4949-9e52-a478f5228c42 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing instance network info cache due to event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-96480a15-1dba-43eb-b392-d20bc8c9777b req-132a148f-e4b0-4949-9e52-a478f5228c42 service nova] Acquiring lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c.converted --force-share --output=json" returned: 0 in 0.214s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "f3447870663cc21a765ad0f324a9267010b5d22c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.630s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "f3447870663cc21a765ad0f324a9267010b5d22c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "f3447870663cc21a765ad0f324a9267010b5d22c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Releasing lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Instance network_info: |[{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-96480a15-1dba-43eb-b392-d20bc8c9777b req-132a148f-e4b0-4949-9e52-a478f5228c42 service nova] Acquired lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG nova.network.neutron [req-96480a15-1dba-43eb-b392-d20bc8c9777b req-132a148f-e4b0-4949-9e52-a478f5228c42 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c,backing_fmt=raw /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c,backing_fmt=raw /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk 1073741824" returned: 0 in 0.052s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "f3447870663cc21a765ad0f324a9267010b5d22c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c --force-share --output=json" returned: 0 in 0.247s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-96480a15-1dba-43eb-b392-d20bc8c9777b req-132a148f-e4b0-4949-9e52-a478f5228c42 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updated VIF entry in instance network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-96480a15-1dba-43eb-b392-d20bc8c9777b req-132a148f-e4b0-4949-9e52-a478f5228c42 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-96480a15-1dba-43eb-b392-d20bc8c9777b req-132a148f-e4b0-4949-9e52-a478f5228c42 service nova] Releasing lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Cannot resize image /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Ensure instance console log exists: /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Start _get_guest_xml network_info=[{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:55:45Z,direct_url=<?>,disk_format='qcow2',id=f4eb7f92-82e1-4927-9b74-f0f6b8dc0206,min_disk=0,min_ram=0,name='tempest-scenario-img--276628540',owner='137870b8216f4a49b1eecde3ec14b75a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:55:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f4eb7f92-82e1-4927-9b74-f0f6b8dc0206'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:55:52 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:55:52 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:55:45Z,direct_url=<?>,disk_format='qcow2',id=f4eb7f92-82e1-4927-9b74-f0f6b8dc0206,min_disk=0,min_ram=0,name='tempest-scenario-img--276628540',owner='137870b8216f4a49b1eecde3ec14b75a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:55:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-650995071',display_name='tempest-TestMinimumBasicScenario-server-650995071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-650995071',id=36,image_ref='f4eb7f92-82e1-4927-9b74-f0f6b8dc0206',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLOipju7bJBwHFlpsL9QrOYGVtYfEtjtaB+hBJdq5pmHzGmBAFES+q5wTzNJhcvBNQWQed2mC4P+6VTTygJpkl7NdmJOL4XewUesgMpc/vko+KkZk+mgQBy5EuRUrzHZg==',key_name='tempest-TestMinimumBasicScenario-1224332270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-9naea2e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4eb7f92-82e1-4927-9b74-f0f6b8dc0206',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:55:50Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=edc8a08d-60ed-46a0-a381-9c5b4af93d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6e:92,bridge_name='br-int',has_traffic_filtering=True,id=2b385ffd-f8e8-472c-a32a-7ee2965b4932,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b385ffd-f8') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'pci_devices' on Instance uuid edc8a08d-60ed-46a0-a381-9c5b4af93d89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:55:52 user nova-compute[74241]:   <uuid>edc8a08d-60ed-46a0-a381-9c5b4af93d89</uuid>
Oct 20 11:55:52 user nova-compute[74241]:   <name>instance-00000024</name>
Oct 20 11:55:52 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:55:52 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:55:52 user nova-compute[74241]:   <metadata>
Oct 20 11:55:52 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:55:52 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:55:52 user nova-compute[74241]:       <nova:name>tempest-TestMinimumBasicScenario-server-650995071</nova:name>
Oct 20 11:55:52 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:55:52</nova:creationTime>
Oct 20 11:55:52 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:55:52 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:55:52 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:55:52 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:55:52 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:55:52 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:55:52 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:55:52 user nova-compute[74241]:       <nova:owner>
Oct 20 11:55:52 user nova-compute[74241]:         <nova:user uuid="cd2b2cd84c5a403f868d69ccc7f8afc4">tempest-TestMinimumBasicScenario-2068641795-project-member</nova:user>
Oct 20 11:55:52 user nova-compute[74241]:         <nova:project uuid="137870b8216f4a49b1eecde3ec14b75a">tempest-TestMinimumBasicScenario-2068641795</nova:project>
Oct 20 11:55:52 user nova-compute[74241]:       </nova:owner>
Oct 20 11:55:52 user nova-compute[74241]:       <nova:root type="image" uuid="f4eb7f92-82e1-4927-9b74-f0f6b8dc0206"/>
Oct 20 11:55:52 user nova-compute[74241]:       <nova:ports>
Oct 20 11:55:52 user nova-compute[74241]:         <nova:port uuid="2b385ffd-f8e8-472c-a32a-7ee2965b4932">
Oct 20 11:55:52 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 11:55:52 user nova-compute[74241]:         </nova:port>
Oct 20 11:55:52 user nova-compute[74241]:       </nova:ports>
Oct 20 11:55:52 user nova-compute[74241]:     </nova:instance>
Oct 20 11:55:52 user nova-compute[74241]:   </metadata>
Oct 20 11:55:52 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:55:52 user nova-compute[74241]:     <system>
Oct 20 11:55:52 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:55:52 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:55:52 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:55:52 user nova-compute[74241]:       <entry name="serial">edc8a08d-60ed-46a0-a381-9c5b4af93d89</entry>
Oct 20 11:55:52 user nova-compute[74241]:       <entry name="uuid">edc8a08d-60ed-46a0-a381-9c5b4af93d89</entry>
Oct 20 11:55:52 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:55:52 user nova-compute[74241]:     </system>
Oct 20 11:55:52 user nova-compute[74241]:   </sysinfo>
Oct 20 11:55:52 user nova-compute[74241]:   <os>
Oct 20 11:55:52 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:55:52 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:55:52 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:55:52 user nova-compute[74241]:   </os>
Oct 20 11:55:52 user nova-compute[74241]:   <features>
Oct 20 11:55:52 user nova-compute[74241]:     <acpi/>
Oct 20 11:55:52 user nova-compute[74241]:     <apic/>
Oct 20 11:55:52 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:55:52 user nova-compute[74241]:   </features>
Oct 20 11:55:52 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:55:52 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:55:52 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:55:52 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:55:52 user nova-compute[74241]:   </clock>
Oct 20 11:55:52 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:55:52 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:55:52 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:55:52 user nova-compute[74241]:   </cpu>
Oct 20 11:55:52 user nova-compute[74241]:   <devices>
Oct 20 11:55:52 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:55:52 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:55:52 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk"/>
Oct 20 11:55:52 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:55:52 user nova-compute[74241]:     </disk>
Oct 20 11:55:52 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:55:52 user nova-compute[74241]:       <mac address="fa:16:3e:5a:6e:92"/>
Oct 20 11:55:52 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:55:52 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:55:52 user nova-compute[74241]:       <target dev="tap2b385ffd-f8"/>
Oct 20 11:55:52 user nova-compute[74241]:     </interface>
Oct 20 11:55:52 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:55:52 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/console.log" append="off"/>
Oct 20 11:55:52 user nova-compute[74241]:     </serial>
Oct 20 11:55:52 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:55:52 user nova-compute[74241]:     <video>
Oct 20 11:55:52 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:55:52 user nova-compute[74241]:     </video>
Oct 20 11:55:52 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:55:52 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:55:52 user nova-compute[74241]:     </rng>
Oct 20 11:55:52 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:55:52 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:55:52 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:55:52 user nova-compute[74241]:     </memballoon>
Oct 20 11:55:52 user nova-compute[74241]:   </devices>
Oct 20 11:55:52 user nova-compute[74241]: </domain>
Oct 20 11:55:52 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-650995071',display_name='tempest-TestMinimumBasicScenario-server-650995071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-650995071',id=36,image_ref='f4eb7f92-82e1-4927-9b74-f0f6b8dc0206',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLOipju7bJBwHFlpsL9QrOYGVtYfEtjtaB+hBJdq5pmHzGmBAFES+q5wTzNJhcvBNQWQed2mC4P+6VTTygJpkl7NdmJOL4XewUesgMpc/vko+KkZk+mgQBy5EuRUrzHZg==',key_name='tempest-TestMinimumBasicScenario-1224332270',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-9naea2e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4eb7f92-82e1-4927-9b74-f0f6b8dc0206',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:55:50Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=edc8a08d-60ed-46a0-a381-9c5b4af93d89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6e:92,bridge_name='br-int',has_traffic_filtering=True,id=2b385ffd-f8e8-472c-a32a-7ee2965b4932,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b385ffd-f8') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG os_vif [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6e:92,bridge_name='br-int',has_traffic_filtering=True,id=2b385ffd-f8e8-472c-a32a-7ee2965b4932,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b385ffd-f8') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '879bbb1b-f492-5292-8cf7-77d136baa8a1', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b385ffd-f8, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b385ffd-f8, col_values=(('qos', UUID('2d8f7f17-58c2-472e-ab81-c27a959d5321')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b385ffd-f8, col_values=(('external_ids', {'iface-id': '2b385ffd-f8e8-472c-a32a-7ee2965b4932', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:6e:92', 'vm-uuid': 'edc8a08d-60ed-46a0-a381-9c5b4af93d89'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:52 user nova-compute[74241]: INFO os_vif [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:6e:92,bridge_name='br-int',has_traffic_filtering=True,id=2b385ffd-f8e8-472c-a32a-7ee2965b4932,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b385ffd-f8')
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No VIF found with MAC fa:16:3e:5a:6e:92, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:55:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-bc9211be-98b5-4571-b614-69e7d3e31971 req-91fd94d0-95e1-4432-a9cf-15dace2a1cfc service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc9211be-98b5-4571-b614-69e7d3e31971 req-91fd94d0-95e1-4432-a9cf-15dace2a1cfc service nova] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc9211be-98b5-4571-b614-69e7d3e31971 req-91fd94d0-95e1-4432-a9cf-15dace2a1cfc service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc9211be-98b5-4571-b614-69e7d3e31971 req-91fd94d0-95e1-4432-a9cf-15dace2a1cfc service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-bc9211be-98b5-4571-b614-69e7d3e31971 req-91fd94d0-95e1-4432-a9cf-15dace2a1cfc service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] No waiting events found dispatching network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:54 user nova-compute[74241]: WARNING nova.compute.manager [req-bc9211be-98b5-4571-b614-69e7d3e31971 req-91fd94d0-95e1-4432-a9cf-15dace2a1cfc service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received unexpected event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 for instance with vm_state building and task_state spawning.
Oct 20 11:55:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:55:55 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Instance spawned successfully.
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:55:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:55:56 user nova-compute[74241]: INFO nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Took 6.37 seconds to spawn the instance on the hypervisor.
Oct 20 11:55:56 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:55:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-8eb85879-eb14-4aba-9e8f-c338974a840d req-9a367745-5930-4711-a393-9977532ab7be service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:55:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8eb85879-eb14-4aba-9e8f-c338974a840d req-9a367745-5930-4711-a393-9977532ab7be service nova] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:55:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8eb85879-eb14-4aba-9e8f-c338974a840d req-9a367745-5930-4711-a393-9977532ab7be service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:55:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8eb85879-eb14-4aba-9e8f-c338974a840d req-9a367745-5930-4711-a393-9977532ab7be service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-8eb85879-eb14-4aba-9e8f-c338974a840d req-9a367745-5930-4711-a393-9977532ab7be service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] No waiting events found dispatching network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:55:56 user nova-compute[74241]: WARNING nova.compute.manager [req-8eb85879-eb14-4aba-9e8f-c338974a840d req-9a367745-5930-4711-a393-9977532ab7be service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received unexpected event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 for instance with vm_state building and task_state spawning.
Oct 20 11:55:56 user nova-compute[74241]: INFO nova.compute.manager [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Took 7.39 seconds to build instance.
Oct 20 11:55:56 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f3e156a1-64e0-4a2e-9362-149da4fe8e28 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.554s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:55:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:55:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:01 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuDiXyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:56:02 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:56:02 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:56:02 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd76d2b-3352-4668-ab9d-fd390645367b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:56:02 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[723c8acf-56d9-4a14-8db2-14421ee3d9ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590] added
Oct 20 11:56:02 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[06525345-344e-4f95-b4b1-bc7479060644]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e53bc1e-b499-4b04-9576-02da7ed30085]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBuDiXyk {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZBuDiXyk" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ffaf90-d64e-4e49-8be0-fbc9393d2c84]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZBuDiXyk'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[271cca35-718d-4d77-a2f1-c9967463d7f2]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4039ce4c-80fe-4c21-a704-d5897be1c7d4]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c5384-7aac-40b4-a56d-8a4afc0c65e4 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c5384-7aac-40b4-a56d-8a4afc0c65e4 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c5384-7aac-40b4-a56d-8a4afc0c65e4 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b021aa-22a8-4d5e-978b-ac428067c1ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590, portal: 172.16.0.220,3260]
Oct 20 11:56:02 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590, portal: 172.16.0.220,3260] successful.
Oct 20 11:56:02 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28a2f29-2138-48a9-a8c9-c39f8bc3c521]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f6776-33ab-40c4-944d-1458df358359]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c5384-7aac-40b4-a56d-8a4afc0c65e4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c5384-7aac-40b4-a56d-8a4afc0c65e4 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f4c5384-7aac-40b4-a56d-8a4afc0c65e4 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:02 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb1a3c1-d410-4791-987a-559a1edf6410]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuDiXyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:56:02 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26362623835613163', 'path': '/dev/sdf'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362623835613163', 'path': '/dev/sdf'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:56:03 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:56:03 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 11:56:03 user nova-compute[74241]:   <target dev="vdc" bus="virtio"/>
Oct 20 11:56:03 user nova-compute[74241]:   <serial>852f3efc-8851-4c60-8a20-10f388bd5590</serial>
Oct 20 11:56:03 user nova-compute[74241]: </disk>
Oct 20 11:56:03 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:03 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] No VIF found with MAC fa:16:3e:e8:28:c0, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b45c6d5-3014-4f69-89b0-e10ef6d2c15b tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.326s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.371s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:05 user nova-compute[74241]: INFO nova.compute.manager [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Detaching volume c404d73f-632a-474c-ac55-76cbfa91b9b2
Oct 20 11:56:06 user nova-compute[74241]: INFO nova.virt.block_device [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Attempting to driver detach volume c404d73f-632a-474c-ac55-76cbfa91b9b2 from mountpoint /dev/vdb
Oct 20 11:56:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Attempting to detach device vdb from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:56:06 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:56:06 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:56:06 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:56:06 user nova-compute[74241]:   <serial>c404d73f-632a-474c-ac55-76cbfa91b9b2</serial>
Oct 20 11:56:06 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:56:06 user nova-compute[74241]: </disk>
Oct 20 11:56:06 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:56:06 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully detached device vdb from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca from the persistent domain config.
Oct 20 11:56:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:56:06 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:56:06 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:56:06 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:56:06 user nova-compute[74241]:   <serial>c404d73f-632a-474c-ac55-76cbfa91b9b2</serial>
Oct 20 11:56:06 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:56:06 user nova-compute[74241]: </disk>
Oct 20 11:56:06 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91/disk.rescue --force-share --output=json" returned: 0 in 0.289s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:56:07 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:56:07 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=25.163330078125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 35e53445-2eb7-4f1f-99a7-256e33e442ca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 600dfdc0-0486-47bc-aeba-be1ae265462f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:56:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:56:08 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:56:08 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:56:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:56:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:56:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:56:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:56:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:56:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:14 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:56:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:24 user nova-compute[74241]: INFO nova.compute.manager [None req-32de042c-4bcd-4947-8662-30dac0e8b5de tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Unrescuing
Oct 20 11:56:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32de042c-4bcd-4947-8662-30dac0e8b5de tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:56:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32de042c-4bcd-4947-8662-30dac0e8b5de tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquired lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:56:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-32de042c-4bcd-4947-8662-30dac0e8b5de tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:56:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-32de042c-4bcd-4947-8662-30dac0e8b5de tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating instance_info_cache with network_info: [{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:56:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-32de042c-4bcd-4947-8662-30dac0e8b5de tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Releasing lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:56:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-32de042c-4bcd-4947-8662-30dac0e8b5de tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'flavor' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:56:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-2fab5d4f-8b51-4e32-b678-03ba7b6efc5b req-1d23a11d-1188-46af-903e-285f17d12285 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:56:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2fab5d4f-8b51-4e32-b678-03ba7b6efc5b req-1d23a11d-1188-46af-903e-285f17d12285 service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2fab5d4f-8b51-4e32-b678-03ba7b6efc5b req-1d23a11d-1188-46af-903e-285f17d12285 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2fab5d4f-8b51-4e32-b678-03ba7b6efc5b req-1d23a11d-1188-46af-903e-285f17d12285 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-2fab5d4f-8b51-4e32-b678-03ba7b6efc5b req-1d23a11d-1188-46af-903e-285f17d12285 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:56:25 user nova-compute[74241]: WARNING nova.compute.manager [req-2fab5d4f-8b51-4e32-b678-03ba7b6efc5b req-1d23a11d-1188-46af-903e-285f17d12285 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:56:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:25 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance destroyed successfully.
Oct 20 11:56:26 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca is timed out.
Oct 20 11:56:26 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully detached device vdb from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca from the live domain config.
Oct 20 11:56:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyFYjPRs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:56:26 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54f4d71-3d67-4643-8768-5b980b879cee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:56:26 user nova-compute[74241]: No targets found.
Oct 20 11:56:26 user nova-compute[74241]: iSNS:
Oct 20 11:56:26 user nova-compute[74241]: No targets found.
Oct 20 11:56:26 user nova-compute[74241]: STATIC:
Oct 20 11:56:26 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2
Oct 20 11:56:26 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:56:26 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:56:26 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa
Oct 20 11:56:26 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:56:26 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:56:26 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:56:26 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:56:26 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:56:26 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590
Oct 20 11:56:26 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:56:26 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:56:26 user nova-compute[74241]: FIRMWARE:
Oct 20 11:56:26 user nova-compute[74241]: No targets found.
Oct 20 11:56:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:56:26 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:56:26 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaad9f91-0943-4661-a093-1f3940d3af06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8a1211-ba06-40dc-8a2a-d936c10763ce]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:26 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:26 user nova-compute[74241]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)
Oct 20 11:56:26 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:26 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:26 user nova-compute[74241]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 (non-flash)
Oct 20 11:56:26 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:26 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5228317880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b814a754-3a45-416b-b910-a44c8a9767b1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d8241c-a7f6-4660-89cb-75e78af32107]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9520e0c9-095a-4d71-896c-5f5aa01ebf2b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4eee8d-aeec-4518-9824-55cbec0ac801]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[29189533-059f-457d-b7c8-904bc9da61c3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4354583e-bcb8-461e-bc5a-f0330999db92]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2, portal: 172.16.0.220,3260]
Oct 20 11:56:27 user nova-compute[74241]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2, portal: 172.16.0.220,3260] successful.
Oct 20 11:56:27 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c404d73f-632a-474c-ac55-76cbfa91b9b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[225697f3-0092-4269-8fe3-c71139aac823]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== disconnect_volume: return (366ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:56:27 user nova-compute[74241]: WARNING nova.compute.manager [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:56:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:56:27 user nova-compute[74241]: WARNING nova.compute.manager [req-388f19f5-342b-435f-8c43-346950b00a67 req-eea0f980-0043-43d9-9ac0-3f14593e3b3d service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:56:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-7f7112da-8456-4570-b462-e364cd45d777 req-22b8c7d6-49d1-4cf7-81a2-881e3f75f4e9 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:56:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7f7112da-8456-4570-b462-e364cd45d777 req-22b8c7d6-49d1-4cf7-81a2-881e3f75f4e9 service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7f7112da-8456-4570-b462-e364cd45d777 req-22b8c7d6-49d1-4cf7-81a2-881e3f75f4e9 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7f7112da-8456-4570-b462-e364cd45d777 req-22b8c7d6-49d1-4cf7-81a2-881e3f75f4e9 service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-7f7112da-8456-4570-b462-e364cd45d777 req-22b8c7d6-49d1-4cf7-81a2-881e3f75f4e9 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:56:29 user nova-compute[74241]: WARNING nova.compute.manager [req-7f7112da-8456-4570-b462-e364cd45d777 req-22b8c7d6-49d1-4cf7-81a2-881e3f75f4e9 service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state rescued and task_state unrescuing.
Oct 20 11:56:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-32de042c-4bcd-4947-8662-30dac0e8b5de tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'flavor' on Instance uuid 600dfdc0-0486-47bc-aeba-be1ae265462f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:56:31 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Ignoring supplied device name: /dev/vdb
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:31 user nova-compute[74241]: INFO nova.compute.manager [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Attaching volume 065869a1-8d4f-4b13-a476-5068a812a1b6 to /dev/vdb
Oct 20 11:56:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-038d3ccd-a8db-4ab7-8e61-5bfbced1a11e req-d3e171a2-96fe-4e31-bd14-298338af1417 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received event network-changed-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG nova.compute.manager [req-038d3ccd-a8db-4ab7-8e61-5bfbced1a11e req-d3e171a2-96fe-4e31-bd14-298338af1417 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Refreshing instance network info cache due to event network-changed-6671c30e-b5a1-4079-b5a6-d9a1df748a54. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-038d3ccd-a8db-4ab7-8e61-5bfbced1a11e req-d3e171a2-96fe-4e31-bd14-298338af1417 service nova] Acquiring lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-038d3ccd-a8db-4ab7-8e61-5bfbced1a11e req-d3e171a2-96fe-4e31-bd14-298338af1417 service nova] Acquired lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-038d3ccd-a8db-4ab7-8e61-5bfbced1a11e req-d3e171a2-96fe-4e31-bd14-298338af1417 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Refreshing network info cache for port 6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG os_brick.utils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2614d09b-a237-4a10-a089-27711ac63e19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d64256a-61ba-47e6-bf97-853bc2f80fab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe8830e-8a5a-4096-879a-9762cea08ae6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[664c4be0-54a2-4c82-bd85-10c9433dd70d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:56:31 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:56:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9c692-538b-41e8-98ce-5f192e0080ec]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG os_brick.utils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:56:31 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Updating existing volume attachment record: 556faf62-2bc6-4981-a618-f53db8f75ce9 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:56:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-038d3ccd-a8db-4ab7-8e61-5bfbced1a11e req-d3e171a2-96fe-4e31-bd14-298338af1417 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Updated VIF entry in instance network info cache for port 6671c30e-b5a1-4079-b5a6-d9a1df748a54. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:56:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-038d3ccd-a8db-4ab7-8e61-5bfbced1a11e req-d3e171a2-96fe-4e31-bd14-298338af1417 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Updating instance_info_cache with network_info: [{"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:56:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-038d3ccd-a8db-4ab7-8e61-5bfbced1a11e req-d3e171a2-96fe-4e31-bd14-298338af1417 service nova] Releasing lock "refresh_cache-600dfdc0-0486-47bc-aeba-be1ae265462f" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:56:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:32 user nova-compute[74241]: DEBUG nova.objects.instance [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:56:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ee20d677-1db5-4452-9409-0dc80b839e5d tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.987s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:34 user nova-compute[74241]: INFO nova.compute.manager [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Detaching volume 852f3efc-8851-4c60-8a20-10f388bd5590
Oct 20 11:56:34 user nova-compute[74241]: INFO nova.virt.block_device [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Attempting to driver detach volume 852f3efc-8851-4c60-8a20-10f388bd5590 from mountpoint /dev/vdc
Oct 20 11:56:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Attempting to detach device vdc from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:56:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:56:34 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:56:34 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 11:56:34 user nova-compute[74241]:   <target dev="vdc" bus="virtio"/>
Oct 20 11:56:34 user nova-compute[74241]:   <serial>852f3efc-8851-4c60-8a20-10f388bd5590</serial>
Oct 20 11:56:34 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 11:56:34 user nova-compute[74241]: </disk>
Oct 20 11:56:34 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:56:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully detached device vdc from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca from the persistent domain config.
Oct 20 11:56:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:56:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:56:34 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:56:34 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 11:56:34 user nova-compute[74241]:   <target dev="vdc" bus="virtio"/>
Oct 20 11:56:34 user nova-compute[74241]:   <serial>852f3efc-8851-4c60-8a20-10f388bd5590</serial>
Oct 20 11:56:34 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 11:56:34 user nova-compute[74241]: </disk>
Oct 20 11:56:34 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:56:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:56:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:56:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:56:44 user nova-compute[74241]: INFO nova.compute.claims [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Claim successful on node user
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:56:44 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:56:44 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Creating image(s)
Oct 20 11:56:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "/opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "/opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:44 user nova-compute[74241]: DEBUG nova.policy [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e8492d48fb64b67a61b253a5119a8d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77cfe58431034fac8204fdc8bbfbde09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.205s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.222s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk 1073741824" returned: 0 in 0.058s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Successfully created port: ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Cannot resize image /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Ensure instance console log exists: /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Successfully updated port: ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "refresh_cache-5a7e6673-27d4-426f-94ad-28b998c9113d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquired lock "refresh_cache-5a7e6673-27d4-426f-94ad-28b998c9113d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-22a666e4-c75d-4e53-9ab7-39e648c8e733 req-8f3d0bac-e462-4e94-85cb-3e372f1c337f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-changed-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-22a666e4-c75d-4e53-9ab7-39e648c8e733 req-8f3d0bac-e462-4e94-85cb-3e372f1c337f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Refreshing instance network info cache due to event network-changed-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22a666e4-c75d-4e53-9ab7-39e648c8e733 req-8f3d0bac-e462-4e94-85cb-3e372f1c337f service nova] Acquiring lock "refresh_cache-5a7e6673-27d4-426f-94ad-28b998c9113d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Updating instance_info_cache with network_info: [{"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Releasing lock "refresh_cache-5a7e6673-27d4-426f-94ad-28b998c9113d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Instance network_info: |[{"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22a666e4-c75d-4e53-9ab7-39e648c8e733 req-8f3d0bac-e462-4e94-85cb-3e372f1c337f service nova] Acquired lock "refresh_cache-5a7e6673-27d4-426f-94ad-28b998c9113d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.neutron [req-22a666e4-c75d-4e53-9ab7-39e648c8e733 req-8f3d0bac-e462-4e94-85cb-3e372f1c337f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Refreshing network info cache for port ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Start _get_guest_xml network_info=[{"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:56:46 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:56:46 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-272858478',display_name='tempest-VolumesNegativeTest-instance-272858478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-272858478',id=37,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77cfe58431034fac8204fdc8bbfbde09',ramdisk_id='',reservation_id='r-dcyyszd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1527527333',owner_user_name='tempest-VolumesNegativeTest-1527527333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:56:45Z,user_data=None,user_id='4e8492d48fb64b67a61b253a5119a8d5',uuid=5a7e6673-27d4-426f-94ad-28b998c9113d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Converting VIF {"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a9:35,bridge_name='br-int',has_traffic_filtering=True,id=ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775,network=Network(55a61d37-fa07-4499-b186-4a96ed57fdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba5d7f9e-0d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.objects.instance [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a7e6673-27d4-426f-94ad-28b998c9113d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:56:46 user nova-compute[74241]:   <uuid>5a7e6673-27d4-426f-94ad-28b998c9113d</uuid>
Oct 20 11:56:46 user nova-compute[74241]:   <name>instance-00000025</name>
Oct 20 11:56:46 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:56:46 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:56:46 user nova-compute[74241]:   <metadata>
Oct 20 11:56:46 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:56:46 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:56:46 user nova-compute[74241]:       <nova:name>tempest-VolumesNegativeTest-instance-272858478</nova:name>
Oct 20 11:56:46 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:56:46</nova:creationTime>
Oct 20 11:56:46 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:56:46 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:56:46 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:56:46 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:56:46 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:56:46 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:56:46 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:56:46 user nova-compute[74241]:       <nova:owner>
Oct 20 11:56:46 user nova-compute[74241]:         <nova:user uuid="4e8492d48fb64b67a61b253a5119a8d5">tempest-VolumesNegativeTest-1527527333-project-member</nova:user>
Oct 20 11:56:46 user nova-compute[74241]:         <nova:project uuid="77cfe58431034fac8204fdc8bbfbde09">tempest-VolumesNegativeTest-1527527333</nova:project>
Oct 20 11:56:46 user nova-compute[74241]:       </nova:owner>
Oct 20 11:56:46 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:56:46 user nova-compute[74241]:       <nova:ports>
Oct 20 11:56:46 user nova-compute[74241]:         <nova:port uuid="ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775">
Oct 20 11:56:46 user nova-compute[74241]:           <nova:ip type="fixed" address="192.168.233.251" ipVersion="4"/>
Oct 20 11:56:46 user nova-compute[74241]:         </nova:port>
Oct 20 11:56:46 user nova-compute[74241]:       </nova:ports>
Oct 20 11:56:46 user nova-compute[74241]:     </nova:instance>
Oct 20 11:56:46 user nova-compute[74241]:   </metadata>
Oct 20 11:56:46 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:56:46 user nova-compute[74241]:     <system>
Oct 20 11:56:46 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:56:46 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:56:46 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:56:46 user nova-compute[74241]:       <entry name="serial">5a7e6673-27d4-426f-94ad-28b998c9113d</entry>
Oct 20 11:56:46 user nova-compute[74241]:       <entry name="uuid">5a7e6673-27d4-426f-94ad-28b998c9113d</entry>
Oct 20 11:56:46 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:56:46 user nova-compute[74241]:     </system>
Oct 20 11:56:46 user nova-compute[74241]:   </sysinfo>
Oct 20 11:56:46 user nova-compute[74241]:   <os>
Oct 20 11:56:46 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:56:46 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:56:46 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:56:46 user nova-compute[74241]:   </os>
Oct 20 11:56:46 user nova-compute[74241]:   <features>
Oct 20 11:56:46 user nova-compute[74241]:     <acpi/>
Oct 20 11:56:46 user nova-compute[74241]:     <apic/>
Oct 20 11:56:46 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:56:46 user nova-compute[74241]:   </features>
Oct 20 11:56:46 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:56:46 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:56:46 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:56:46 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:56:46 user nova-compute[74241]:   </clock>
Oct 20 11:56:46 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:56:46 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:56:46 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:56:46 user nova-compute[74241]:   </cpu>
Oct 20 11:56:46 user nova-compute[74241]:   <devices>
Oct 20 11:56:46 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:56:46 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:56:46 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk"/>
Oct 20 11:56:46 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:56:46 user nova-compute[74241]:     </disk>
Oct 20 11:56:46 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:56:46 user nova-compute[74241]:       <mac address="fa:16:3e:0b:a9:35"/>
Oct 20 11:56:46 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:56:46 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:56:46 user nova-compute[74241]:       <target dev="tapba5d7f9e-0d"/>
Oct 20 11:56:46 user nova-compute[74241]:     </interface>
Oct 20 11:56:46 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:56:46 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/console.log" append="off"/>
Oct 20 11:56:46 user nova-compute[74241]:     </serial>
Oct 20 11:56:46 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:56:46 user nova-compute[74241]:     <video>
Oct 20 11:56:46 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:56:46 user nova-compute[74241]:     </video>
Oct 20 11:56:46 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:56:46 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:56:46 user nova-compute[74241]:     </rng>
Oct 20 11:56:46 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:56:46 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:56:46 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:56:46 user nova-compute[74241]:     </memballoon>
Oct 20 11:56:46 user nova-compute[74241]:   </devices>
Oct 20 11:56:46 user nova-compute[74241]: </domain>
Oct 20 11:56:46 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-272858478',display_name='tempest-VolumesNegativeTest-instance-272858478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-272858478',id=37,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77cfe58431034fac8204fdc8bbfbde09',ramdisk_id='',reservation_id='r-dcyyszd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1527527333',owner_user_name='tempest-VolumesNegativeTest-1527527333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:56:45Z,user_data=None,user_id='4e8492d48fb64b67a61b253a5119a8d5',uuid=5a7e6673-27d4-426f-94ad-28b998c9113d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Converting VIF {"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a9:35,bridge_name='br-int',has_traffic_filtering=True,id=ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775,network=Network(55a61d37-fa07-4499-b186-4a96ed57fdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba5d7f9e-0d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG os_vif [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a9:35,bridge_name='br-int',has_traffic_filtering=True,id=ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775,network=Network(55a61d37-fa07-4499-b186-4a96ed57fdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba5d7f9e-0d') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1ca809b-261d-5955-9af2-a5238f1ebf76', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba5d7f9e-0d, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba5d7f9e-0d, col_values=(('qos', UUID('be972775-723f-4b6e-a80b-3e2a2218334d')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba5d7f9e-0d, col_values=(('external_ids', {'iface-id': 'ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:a9:35', 'vm-uuid': '5a7e6673-27d4-426f-94ad-28b998c9113d'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:46 user nova-compute[74241]: INFO os_vif [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a9:35,bridge_name='br-int',has_traffic_filtering=True,id=ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775,network=Network(55a61d37-fa07-4499-b186-4a96ed57fdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba5d7f9e-0d')
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:56:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] No VIF found with MAC fa:16:3e:0b:a9:35, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:56:47 user nova-compute[74241]: DEBUG nova.network.neutron [req-22a666e4-c75d-4e53-9ab7-39e648c8e733 req-8f3d0bac-e462-4e94-85cb-3e372f1c337f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Updated VIF entry in instance network info cache for port ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:56:47 user nova-compute[74241]: DEBUG nova.network.neutron [req-22a666e4-c75d-4e53-9ab7-39e648c8e733 req-8f3d0bac-e462-4e94-85cb-3e372f1c337f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Updating instance_info_cache with network_info: [{"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:56:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22a666e4-c75d-4e53-9ab7-39e648c8e733 req-8f3d0bac-e462-4e94-85cb-3e372f1c337f service nova] Releasing lock "refresh_cache-5a7e6673-27d4-426f-94ad-28b998c9113d" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:56:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-fc32c70f-ce8c-4152-9412-95c87c5a83b9 req-1d3b5812-b2e1-488f-8394-7c46dcc4c148 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:56:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fc32c70f-ce8c-4152-9412-95c87c5a83b9 req-1d3b5812-b2e1-488f-8394-7c46dcc4c148 service nova] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fc32c70f-ce8c-4152-9412-95c87c5a83b9 req-1d3b5812-b2e1-488f-8394-7c46dcc4c148 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fc32c70f-ce8c-4152-9412-95c87c5a83b9 req-1d3b5812-b2e1-488f-8394-7c46dcc4c148 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-fc32c70f-ce8c-4152-9412-95c87c5a83b9 req-1d3b5812-b2e1-488f-8394-7c46dcc4c148 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] No waiting events found dispatching network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:56:48 user nova-compute[74241]: WARNING nova.compute.manager [req-fc32c70f-ce8c-4152-9412-95c87c5a83b9 req-1d3b5812-b2e1-488f-8394-7c46dcc4c148 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received unexpected event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 for instance with vm_state building and task_state spawning.
Oct 20 11:56:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:56:50 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Instance spawned successfully.
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-6c2e247f-6547-4962-914e-50ffa2abcc29 req-a726e410-6941-4041-a0f6-3ce5a4995542 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6c2e247f-6547-4962-914e-50ffa2abcc29 req-a726e410-6941-4041-a0f6-3ce5a4995542 service nova] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6c2e247f-6547-4962-914e-50ffa2abcc29 req-a726e410-6941-4041-a0f6-3ce5a4995542 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6c2e247f-6547-4962-914e-50ffa2abcc29 req-a726e410-6941-4041-a0f6-3ce5a4995542 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-6c2e247f-6547-4962-914e-50ffa2abcc29 req-a726e410-6941-4041-a0f6-3ce5a4995542 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] No waiting events found dispatching network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:56:50 user nova-compute[74241]: WARNING nova.compute.manager [req-6c2e247f-6547-4962-914e-50ffa2abcc29 req-a726e410-6941-4041-a0f6-3ce5a4995542 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received unexpected event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 for instance with vm_state building and task_state spawning.
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxyiQKTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:56:50 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:56:50 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:56:50 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ad81ab-8a15-49d1-a8a6-fcd785721ca0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:56:50 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b033b372-6417-47c2-8035-b0e20120de6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6] added
Oct 20 11:56:50 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9d0b06-b41f-4157-ba3c-62f407a7e387]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:50 user nova-compute[74241]: INFO nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Took 5.93 seconds to spawn the instance on the hypervisor.
Oct 20 11:56:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32d41d-930e-4161-b8de-3faf11f68670]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxyiQKTk {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uxyiQKTk" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[75212a27-922d-45f6-ad87-495aac525f61]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uxyiQKTk'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f871689-1a80-4c8d-ab45-485db86dc453]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b93e9f5-54b5-4ea0-9979-b1723eece7c1]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:50 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:50 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:50 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:50 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:50 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:50 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:50 user nova-compute[74241]: INFO nova.compute.manager [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Took 6.92 seconds to build instance.
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb709297-388e-45d2-8c2e-3961ad5986ca tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.051s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc5f1c2-e3ca-4e32-a22f-fa72fd6f332b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6, portal: 172.16.0.220,3260]
Oct 20 11:56:50 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6, portal: 172.16.0.220,3260] successful.
Oct 20 11:56:50 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:50 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a121add4-2292-449f-8966-e5632bccdeef]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f46e0b6-24ff-4392-a0f5-45bbaa968507]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:51 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:51 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:51 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:56:51 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:51 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:51 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:51 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:56:51 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1d274b-a2b7-4090-9aeb-293f3333a9bd]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxyiQKTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:56:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23836666464366562', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836666464366562', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG nova.objects.instance [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'flavor' on Instance uuid 600dfdc0-0486-47bc-aeba-be1ae265462f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:56:52 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:56:52 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:56:52 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:56:52 user nova-compute[74241]:   <serial>065869a1-8d4f-4b13-a476-5068a812a1b6</serial>
Oct 20 11:56:52 user nova-compute[74241]: </disk>
Oct 20 11:56:52 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] No VIF found with MAC fa:16:3e:31:4d:a6, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-67211e12-7c4b-4087-8df3-e79f18c63934 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.405s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:56:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:56:54 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca is timed out.
Oct 20 11:56:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully detached device vdc from instance 35e53445-2eb7-4f1f-99a7-256e33e442ca from the live domain config.
Oct 20 11:56:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZBuDiXyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:56:54 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a416a5-d094-444c-81b1-620389cc7fa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:56:54 user nova-compute[74241]: No targets found.
Oct 20 11:56:54 user nova-compute[74241]: iSNS:
Oct 20 11:56:54 user nova-compute[74241]: No targets found.
Oct 20 11:56:54 user nova-compute[74241]: STATIC:
Oct 20 11:56:54 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6
Oct 20 11:56:54 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:56:54 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:56:54 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa
Oct 20 11:56:54 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:56:54 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:56:54 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:56:54 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:56:54 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:56:54 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590
Oct 20 11:56:54 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:56:54 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:56:54 user nova-compute[74241]: FIRMWARE:
Oct 20 11:56:54 user nova-compute[74241]: No targets found.
Oct 20 11:56:54 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:56:54 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:56:54 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0529310f-50dd-4f6e-9f82-85820f3a60e5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[767bc31a-fa38-4883-a081-5660900ae3fe]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:54 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:54 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:54 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:56:54 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:56:54 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:56:54 user nova-compute[74241]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 (non-flash)
Oct 20 11:56:54 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:56:54 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52283b6a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590'): ({'sdf'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Removing single pathed devices sdf {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8402a-3e87-4dc5-b92c-f33b7a42cba6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c72812-da11-4922-b803-549c0edb0d98]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Flushing IO for device /dev/sdf {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc48bbdc-3774-46e9-8c27-3926a520f9f3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bceeac7-1683-4e0a-a0cd-3749049ab17d]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] SCSI volumes sdf have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dacd8e5-e357-4c08-841f-739bc992b76b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3022b370-d768-4cae-afaf-b2d047d8af04]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590, portal: 172.16.0.220,3260]
Oct 20 11:56:54 user nova-compute[74241]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590, portal: 172.16.0.220,3260] successful.
Oct 20 11:56:54 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:852f3efc-8851-4c60-8a20-10f388bd5590 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea38aa7a-1b96-4fa8-a0e3-a9987664ce86]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] <== disconnect_volume: return (350ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:56:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:56:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:57:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:57:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'flavor' on Instance uuid 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:57:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b889b0a6-4cfd-4499-9f43-85984be09441 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.977s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:03 user nova-compute[74241]: INFO nova.compute.manager [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Terminating instance
Oct 20 11:57:03 user nova-compute[74241]: DEBUG nova.compute.manager [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-b35f9a3a-6deb-45ba-a9e1-2d0a86f88d4b req-57be2318-ee95-4180-b386-54efcf369c62 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-unplugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b35f9a3a-6deb-45ba-a9e1-2d0a86f88d4b req-57be2318-ee95-4180-b386-54efcf369c62 service nova] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b35f9a3a-6deb-45ba-a9e1-2d0a86f88d4b req-57be2318-ee95-4180-b386-54efcf369c62 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b35f9a3a-6deb-45ba-a9e1-2d0a86f88d4b req-57be2318-ee95-4180-b386-54efcf369c62 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-b35f9a3a-6deb-45ba-a9e1-2d0a86f88d4b req-57be2318-ee95-4180-b386-54efcf369c62 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] No waiting events found dispatching network-vif-unplugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:57:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-b35f9a3a-6deb-45ba-a9e1-2d0a86f88d4b req-57be2318-ee95-4180-b386-54efcf369c62 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-unplugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Instance destroyed successfully.
Oct 20 11:57:04 user nova-compute[74241]: DEBUG nova.objects.instance [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lazy-loading 'resources' on Instance uuid 35e53445-2eb7-4f1f-99a7-256e33e442ca {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:53:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1054960772',display_name='tempest-AttachVolumeTestJSON-server-1054960772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1054960772',id=34,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+HOxyqEDaBErWs927nMVxdXwYJCkZ2nZVRay+eL0DDrMHbP0+eEqdjuHz5zxdAlhyfJqmgfB+XAhoOSAe5P2c96fny+qhJtnpj4sRm28zUYKfvbvFflGVnD8iPCXMntA==',key_name='tempest-keypair-396070698',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2181a0d9a273487eaa81ad8acd48c8e9',ramdisk_id='',reservation_id='r-nddw9zf6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1958556215',owner_user_name='tempest-AttachVolumeTestJSON-1958556215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:53:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f2c95648d124219b0505d18ebc85f5d',uuid=35e53445-2eb7-4f1f-99a7-256e33e442ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converting VIF {"id": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "address": "fa:16:3e:e8:28:c0", "network": {"id": "5f43d771-341d-4f30-9c78-98079aa758b7", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-65528934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2181a0d9a273487eaa81ad8acd48c8e9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc8f8122-a0", "ovs_interfaceid": "cc8f8122-a0f6-47f2-9cb4-436a2ba06999", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc8f8122-a0f6-47f2-9cb4-436a2ba06999,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f8122-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG os_vif [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc8f8122-a0f6-47f2-9cb4-436a2ba06999,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f8122-a0') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc8f8122-a0, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ec226f2-8611-42e3-bb30-9b74f88050e3) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:57:04 user nova-compute[74241]: INFO os_vif [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:28:c0,bridge_name='br-int',has_traffic_filtering=True,id=cc8f8122-a0f6-47f2-9cb4-436a2ba06999,network=Network(5f43d771-341d-4f30-9c78-98079aa758b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc8f8122-a0')
Oct 20 11:57:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Deleting instance files /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca_del
Oct 20 11:57:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Deletion of /opt/stack/data/nova/instances/35e53445-2eb7-4f1f-99a7-256e33e442ca_del complete
Oct 20 11:57:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:04 user nova-compute[74241]: INFO nova.compute.manager [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 11:57:04 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:57:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-f4b38d85-9aae-427c-9910-7598edb7e009 req-db83e10b-3111-4a17-9dd5-4c14a393ccd0 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-deleted-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:05 user nova-compute[74241]: INFO nova.compute.manager [req-f4b38d85-9aae-427c-9910-7598edb7e009 req-db83e10b-3111-4a17-9dd5-4c14a393ccd0 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Neutron deleted interface cc8f8122-a0f6-47f2-9cb4-436a2ba06999; detaching it from the instance and deleting it from the info cache
Oct 20 11:57:05 user nova-compute[74241]: DEBUG nova.network.neutron [req-f4b38d85-9aae-427c-9910-7598edb7e009 req-db83e10b-3111-4a17-9dd5-4c14a393ccd0 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:57:05 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Took 0.84 seconds to deallocate network for instance.
Oct 20 11:57:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-f4b38d85-9aae-427c-9910-7598edb7e009 req-db83e10b-3111-4a17-9dd5-4c14a393ccd0 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Detach interface failed, port_id=cc8f8122-a0f6-47f2-9cb4-436a2ba06999, reason: Instance 35e53445-2eb7-4f1f-99a7-256e33e442ca could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:05 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] No waiting events found dispatching network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:57:06 user nova-compute[74241]: WARNING nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received unexpected event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 for instance with vm_state deleted and task_state None.
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] No waiting events found dispatching network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:57:06 user nova-compute[74241]: WARNING nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received unexpected event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 for instance with vm_state deleted and task_state None.
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] No waiting events found dispatching network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:57:06 user nova-compute[74241]: WARNING nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received unexpected event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 for instance with vm_state deleted and task_state None.
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-unplugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] No waiting events found dispatching network-vif-unplugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:57:06 user nova-compute[74241]: WARNING nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received unexpected event network-vif-unplugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 for instance with vm_state deleted and task_state None.
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Acquiring lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] No waiting events found dispatching network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:57:06 user nova-compute[74241]: WARNING nova.compute.manager [req-2256f8f3-f95e-49f1-ab08-0a8f6b11717b req-0e5dbf38-4a37-465c-bb5b-70fdf57fef82 service nova] [instance: 35e53445-2eb7-4f1f-99a7-256e33e442ca] Received unexpected event network-vif-plugged-cc8f8122-a0f6-47f2-9cb4-436a2ba06999 for instance with vm_state deleted and task_state None.
Oct 20 11:57:06 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Deleted allocations for instance 35e53445-2eb7-4f1f-99a7-256e33e442ca
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-911fcb4d-399e-4e63-a7ad-c96effe9d890 tempest-AttachVolumeTestJSON-1958556215 tempest-AttachVolumeTestJSON-1958556215-project-member] Lock "35e53445-2eb7-4f1f-99a7-256e33e442ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.554s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:57:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:57:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-9486687a-41bc-40af-b1d3-3db64ce78717 req-a37096fb-7abd-4352-9a40-9ba9306ef06c service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-changed-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-9486687a-41bc-40af-b1d3-3db64ce78717 req-a37096fb-7abd-4352-9a40-9ba9306ef06c service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Refreshing instance network info cache due to event network-changed-d7f9f66f-674b-41d6-9460-5f0be423b6d1. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9486687a-41bc-40af-b1d3-3db64ce78717 req-a37096fb-7abd-4352-9a40-9ba9306ef06c service nova] Acquiring lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9486687a-41bc-40af-b1d3-3db64ce78717 req-a37096fb-7abd-4352-9a40-9ba9306ef06c service nova] Acquired lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG nova.network.neutron [req-9486687a-41bc-40af-b1d3-3db64ce78717 req-a37096fb-7abd-4352-9a40-9ba9306ef06c service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Refreshing network info cache for port d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:57:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:57:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:57:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7881MB free_disk=25.13385009765625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 600dfdc0-0486-47bc-aeba-be1ae265462f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5a7e6673-27d4-426f-94ad-28b998c9113d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:09 user nova-compute[74241]: INFO nova.compute.manager [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Detaching volume b1fd0cc6-8526-49ac-8f16-da9747940bfa
Oct 20 11:57:09 user nova-compute[74241]: INFO nova.virt.block_device [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Attempting to driver detach volume b1fd0cc6-8526-49ac-8f16-da9747940bfa from mountpoint /dev/vdb
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Attempting to detach device vdb from instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:57:09 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:57:09 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:57:09 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:57:09 user nova-compute[74241]:   <serial>b1fd0cc6-8526-49ac-8f16-da9747940bfa</serial>
Oct 20 11:57:09 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:57:09 user nova-compute[74241]: </disk>
Oct 20 11:57:09 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:57:09 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Successfully detached device vdb from instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be from the persistent domain config.
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:57:09 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:57:09 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:57:09 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:57:09 user nova-compute[74241]:   <serial>b1fd0cc6-8526-49ac-8f16-da9747940bfa</serial>
Oct 20 11:57:09 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:57:09 user nova-compute[74241]: </disk>
Oct 20 11:57:09 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-9486687a-41bc-40af-b1d3-3db64ce78717 req-a37096fb-7abd-4352-9a40-9ba9306ef06c service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updated VIF entry in instance network info cache for port d7f9f66f-674b-41d6-9460-5f0be423b6d1. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-9486687a-41bc-40af-b1d3-3db64ce78717 req-a37096fb-7abd-4352-9a40-9ba9306ef06c service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9486687a-41bc-40af-b1d3-3db64ce78717 req-a37096fb-7abd-4352-9a40-9ba9306ef06c service nova] Releasing lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-b02eacd4-4ff9-4fb8-a731-73241630214b req-ed666447-9856-44ac-822c-a5d23bc619e5 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-changed-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-b02eacd4-4ff9-4fb8-a731-73241630214b req-ed666447-9856-44ac-822c-a5d23bc619e5 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Refreshing instance network info cache due to event network-changed-d7f9f66f-674b-41d6-9460-5f0be423b6d1. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b02eacd4-4ff9-4fb8-a731-73241630214b req-ed666447-9856-44ac-822c-a5d23bc619e5 service nova] Acquiring lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b02eacd4-4ff9-4fb8-a731-73241630214b req-ed666447-9856-44ac-822c-a5d23bc619e5 service nova] Acquired lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG nova.network.neutron [req-b02eacd4-4ff9-4fb8-a731-73241630214b req-ed666447-9856-44ac-822c-a5d23bc619e5 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Refreshing network info cache for port d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:57:10 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:57:11 user nova-compute[74241]: DEBUG nova.network.neutron [req-b02eacd4-4ff9-4fb8-a731-73241630214b req-ed666447-9856-44ac-822c-a5d23bc619e5 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updated VIF entry in instance network info cache for port d7f9f66f-674b-41d6-9460-5f0be423b6d1. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:57:11 user nova-compute[74241]: DEBUG nova.network.neutron [req-b02eacd4-4ff9-4fb8-a731-73241630214b req-ed666447-9856-44ac-822c-a5d23bc619e5 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [{"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:57:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b02eacd4-4ff9-4fb8-a731-73241630214b req-ed666447-9856-44ac-822c-a5d23bc619e5 service nova] Releasing lock "refresh_cache-e1bd5ec5-ad87-45bd-ba69-ad979258a9be" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:57:11 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updating instance_info_cache with network_info: [{"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:57:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-031a2001-57b8-4411-bed1-69eac953d40b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:57:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:57:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:15 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:57:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:29 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be is timed out.
Oct 20 11:57:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Successfully detached device vdb from instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be from the live domain config.
Oct 20 11:57:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KVPXDgaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:57:29 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5257ecdb-b83e-4012-952e-c27845bd399a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:57:29 user nova-compute[74241]: No targets found.
Oct 20 11:57:29 user nova-compute[74241]: iSNS:
Oct 20 11:57:29 user nova-compute[74241]: No targets found.
Oct 20 11:57:29 user nova-compute[74241]: STATIC:
Oct 20 11:57:29 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6
Oct 20 11:57:29 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:57:29 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:57:29 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa
Oct 20 11:57:29 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:57:29 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:57:29 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:57:29 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:57:29 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:57:29 user nova-compute[74241]: FIRMWARE:
Oct 20 11:57:29 user nova-compute[74241]: No targets found.
Oct 20 11:57:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:57:29 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:57:29 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e5f666-d462-4ea8-977f-fab773a9026f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed950b4-a0db-45a7-91bf-fcbf9d313dc8]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:57:29 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:57:29 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:57:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa (non-flash)
Oct 20 11:57:29 user nova-compute[74241]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:57:29 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:57:29 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52283b97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42d56af-ffcd-4607-884c-2ce0b3dd4f07]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead8f9cb-2cb8-45b3-87bf-57402cc64594]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c8623a-b488-486d-b36c-fbf992ff6938]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[75500bc3-87b2-46c3-97d5-fda8a5ea7b91]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[672cd683-014d-437a-b02c-6c51078ab94c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:57:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ef47b3-c16d-440f-89f8-3c55ed7dc943]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa, portal: 172.16.0.220,3260]
Oct 20 11:57:30 user nova-compute[74241]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa, portal: 172.16.0.220,3260] successful.
Oct 20 11:57:30 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1fd0cc6-8526-49ac-8f16-da9747940bfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa09483-8e02-42ad-ba92-836eeb6346c3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] <== disconnect_volume: return (296ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG nova.objects.instance [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'flavor' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:57:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-03a96595-c8a5-4344-a5e1-c0fa1435aa87 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.781s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:57:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:57:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:57:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:57:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:43 user nova-compute[74241]: DEBUG nova.objects.instance [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'flavor' on Instance uuid edc8a08d-60ed-46a0-a381-9c5b4af93d89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:57:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:43 user nova-compute[74241]: INFO nova.compute.manager [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Attaching volume 627783f3-b72d-4e08-94ed-0f5478cae201 to /dev/vdb
Oct 20 11:57:44 user nova-compute[74241]: DEBUG os_brick.utils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a238c4-acb8-4486-ba1f-d40b664f55e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4de7698-2f07-4378-9c44-74ed39f96b5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae052e1-b459-4bad-8e65-23a7f0e0079c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0074cd1b-c7dd-4036-9e0c-5ea8fdf30417]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 11:57:44 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 11:57:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba5debf-dae9-4952-805b-7cb28336b8c8]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG os_brick.utils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating existing volume attachment record: 47bcfc8a-805a-4cfb-addf-0bfce7d54216 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 11:57:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:57:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:54 user nova-compute[74241]: INFO nova.compute.manager [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Detaching volume 065869a1-8d4f-4b13-a476-5068a812a1b6
Oct 20 11:57:55 user nova-compute[74241]: INFO nova.virt.block_device [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Attempting to driver detach volume 065869a1-8d4f-4b13-a476-5068a812a1b6 from mountpoint /dev/vdb
Oct 20 11:57:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Attempting to detach device vdb from instance 600dfdc0-0486-47bc-aeba-be1ae265462f from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 11:57:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:57:55 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:57:55 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:57:55 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:57:55 user nova-compute[74241]:   <serial>065869a1-8d4f-4b13-a476-5068a812a1b6</serial>
Oct 20 11:57:55 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:57:55 user nova-compute[74241]: </disk>
Oct 20 11:57:55 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:57:55 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:55 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Successfully detached device vdb from instance 600dfdc0-0486-47bc-aeba-be1ae265462f from the persistent domain config.
Oct 20 11:57:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 600dfdc0-0486-47bc-aeba-be1ae265462f from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 11:57:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 11:57:55 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:57:55 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 11:57:55 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:57:55 user nova-compute[74241]:   <serial>065869a1-8d4f-4b13-a476-5068a812a1b6</serial>
Oct 20 11:57:55 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 11:57:55 user nova-compute[74241]: </disk>
Oct 20 11:57:55 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 11:57:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 600dfdc0-0486-47bc-aeba-be1ae265462f {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:59 user nova-compute[74241]: INFO nova.compute.manager [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Terminating instance
Oct 20 11:57:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-b6153633-03dc-4e59-b68e-9e4bf483c914 req-7b662639-eae5-4afd-8b0e-72c1c3b6b226 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b6153633-03dc-4e59-b68e-9e4bf483c914 req-7b662639-eae5-4afd-8b0e-72c1c3b6b226 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b6153633-03dc-4e59-b68e-9e4bf483c914 req-7b662639-eae5-4afd-8b0e-72c1c3b6b226 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b6153633-03dc-4e59-b68e-9e4bf483c914 req-7b662639-eae5-4afd-8b0e-72c1c3b6b226 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-b6153633-03dc-4e59-b68e-9e4bf483c914 req-7b662639-eae5-4afd-8b0e-72c1c3b6b226 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:57:59 user nova-compute[74241]: DEBUG nova.compute.manager [req-b6153633-03dc-4e59-b68e-9e4bf483c914 req-7b662639-eae5-4afd-8b0e-72c1c3b6b226 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-unplugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Instance destroyed successfully.
Oct 20 11:58:00 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'resources' on Instance uuid e1bd5ec5-ad87-45bd-ba69-ad979258a9be {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:50:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-550887458',display_name='tempest-ServerRescueNegativeTestJSON-server-550887458',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-550887458',id=31,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE97RzNueek15qvzFipBWLRsLZQicogNQi2U1snsTzV3Rlzzpvue1LEwiFCPaIiUMWBmryDPeNhiqsYhY3dRen8M1Ue/Y27ILFXFAoMJAr7pdJBrh/acghFPHguk3gSUAw==',key_name='tempest-keypair-1249799456',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-4srw336e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:55:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=e1bd5ec5-ad87-45bd-ba69-ad979258a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "address": "fa:16:3e:38:10:a9", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7f9f66f-67", "ovs_interfaceid": "d7f9f66f-674b-41d6-9460-5f0be423b6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:10:a9,bridge_name='br-int',has_traffic_filtering=True,id=d7f9f66f-674b-41d6-9460-5f0be423b6d1,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f9f66f-67') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG os_vif [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:10:a9,bridge_name='br-int',has_traffic_filtering=True,id=d7f9f66f-674b-41d6-9460-5f0be423b6d1,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f9f66f-67') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7f9f66f-67, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf1025cd-5478-40f5-bdcb-c4dc8ac1a237) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:00 user nova-compute[74241]: INFO os_vif [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:10:a9,bridge_name='br-int',has_traffic_filtering=True,id=d7f9f66f-674b-41d6-9460-5f0be423b6d1,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7f9f66f-67')
Oct 20 11:58:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Deleting instance files /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be_del
Oct 20 11:58:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Deletion of /opt/stack/data/nova/instances/e1bd5ec5-ad87-45bd-ba69-ad979258a9be_del complete
Oct 20 11:58:00 user nova-compute[74241]: INFO nova.compute.manager [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 11:58:00 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:58:00 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHRAwrbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:58:01 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:58:01 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:58:01 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef3651e-d09a-48e4-b581-dce607d098b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 11:58:01 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c839372-05f1-479d-9ad4-8e7b65ce7100]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201] added
Oct 20 11:58:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[261e9791-4d81-4f14-bc3f-65c00535f303]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47fd2e6-d0a9-4d30-b865-1f8aa2b47630]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHRAwrbO {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHRAwrbO" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e81e67-d16d-4932-a2b2-1826b99f4b1b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHRAwrbO'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2fc838-8886-4321-a634-8e094177859a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d628c33-9817-4eb5-93c2-1f1b569e0227]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:01 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Took 0.72 seconds to deallocate network for instance.
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b0e63e-ef5a-46dc-a8b4-910ff431dae6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201, portal: 172.16.0.220,3260]
Oct 20 11:58:01 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201, portal: 172.16.0.220,3260] successful.
Oct 20 11:58:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4685b-4f75-43ba-8075-7c0fed6ab847]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[760f04e7-abca-43de-bb62-ebac4d2ad289]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)
Oct 20 11:58:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85bb1ff-2b3c-4fca-a799-f79c0c7ba57e]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:01 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Deleted allocations for instance e1bd5ec5-ad87-45bd-ba69-ad979258a9be
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2d5447de-bf3a-4322-a88f-d722b9504959 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.179s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-279661d7-c4c7-4937-a4d1-bc3f0f705e35 req-299a949f-2314-4fe0-9ced-0f8e7726f475 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-279661d7-c4c7-4937-a4d1-bc3f0f705e35 req-299a949f-2314-4fe0-9ced-0f8e7726f475 service nova] Acquiring lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-279661d7-c4c7-4937-a4d1-bc3f0f705e35 req-299a949f-2314-4fe0-9ced-0f8e7726f475 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-279661d7-c4c7-4937-a4d1-bc3f0f705e35 req-299a949f-2314-4fe0-9ced-0f8e7726f475 service nova] Lock "e1bd5ec5-ad87-45bd-ba69-ad979258a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-279661d7-c4c7-4937-a4d1-bc3f0f705e35 req-299a949f-2314-4fe0-9ced-0f8e7726f475 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] No waiting events found dispatching network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:01 user nova-compute[74241]: WARNING nova.compute.manager [req-279661d7-c4c7-4937-a4d1-bc3f0f705e35 req-299a949f-2314-4fe0-9ced-0f8e7726f475 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received unexpected event network-vif-plugged-d7f9f66f-674b-41d6-9460-5f0be423b6d1 for instance with vm_state deleted and task_state None.
Oct 20 11:58:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-279661d7-c4c7-4937-a4d1-bc3f0f705e35 req-299a949f-2314-4fe0-9ced-0f8e7726f475 service nova] [instance: e1bd5ec5-ad87-45bd-ba69-ad979258a9be] Received event network-vif-deleted-d7f9f66f-674b-41d6-9460-5f0be423b6d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHRAwrbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26162343065376231', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162343065376231', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'flavor' on Instance uuid edc8a08d-60ed-46a0-a381-9c5b4af93d89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 11:58:02 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 11:58:02 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 11:58:02 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 11:58:02 user nova-compute[74241]:   <serial>627783f3-b72d-4e08-94ed-0f5478cae201</serial>
Oct 20 11:58:02 user nova-compute[74241]: </disk>
Oct 20 11:58:02 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] No VIF found with MAC fa:16:3e:5a:6e:92, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:58:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-adb4751c-d204-40f9-95b1-918fe7887494 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.988s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:04 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:04 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:58:04 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:58:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-a354b350-cd83-4f33-9d6d-bb8b46f4b7e0 req-f5ecf006-0e09-4760-97fd-112bd62baefb service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-a354b350-cd83-4f33-9d6d-bb8b46f4b7e0 req-f5ecf006-0e09-4760-97fd-112bd62baefb service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing instance network info cache due to event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a354b350-cd83-4f33-9d6d-bb8b46f4b7e0 req-f5ecf006-0e09-4760-97fd-112bd62baefb service nova] Acquiring lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a354b350-cd83-4f33-9d6d-bb8b46f4b7e0 req-f5ecf006-0e09-4760-97fd-112bd62baefb service nova] Acquired lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG nova.network.neutron [req-a354b350-cd83-4f33-9d6d-bb8b46f4b7e0 req-f5ecf006-0e09-4760-97fd-112bd62baefb service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-a354b350-cd83-4f33-9d6d-bb8b46f4b7e0 req-f5ecf006-0e09-4760-97fd-112bd62baefb service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updated VIF entry in instance network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-a354b350-cd83-4f33-9d6d-bb8b46f4b7e0 req-f5ecf006-0e09-4760-97fd-112bd62baefb service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a354b350-cd83-4f33-9d6d-bb8b46f4b7e0 req-f5ecf006-0e09-4760-97fd-112bd62baefb service nova] Releasing lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-1a126c34-1498-4b70-98b9-286cc21a3937 req-f57da743-308b-45a5-8416-543b5cc03079 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-1a126c34-1498-4b70-98b9-286cc21a3937 req-f57da743-308b-45a5-8416-543b5cc03079 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing instance network info cache due to event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1a126c34-1498-4b70-98b9-286cc21a3937 req-f57da743-308b-45a5-8416-543b5cc03079 service nova] Acquiring lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1a126c34-1498-4b70-98b9-286cc21a3937 req-f57da743-308b-45a5-8416-543b5cc03079 service nova] Acquired lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG nova.network.neutron [req-1a126c34-1498-4b70-98b9-286cc21a3937 req-f57da743-308b-45a5-8416-543b5cc03079 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:58:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8150MB free_disk=25.148845672607422GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:08 user nova-compute[74241]: INFO nova.compute.manager [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Rebooting instance
Oct 20 11:58:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 600dfdc0-0486-47bc-aeba-be1ae265462f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 5a7e6673-27d4-426f-94ad-28b998c9113d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.network.neutron [req-1a126c34-1498-4b70-98b9-286cc21a3937 req-f57da743-308b-45a5-8416-543b5cc03079 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updated VIF entry in instance network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.network.neutron [req-1a126c34-1498-4b70-98b9-286cc21a3937 req-f57da743-308b-45a5-8416-543b5cc03079 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1a126c34-1498-4b70-98b9-286cc21a3937 req-f57da743-308b-45a5-8416-543b5cc03079 service nova] Releasing lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquired lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:58:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Releasing lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:58:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:58:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:58:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:58:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:58:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updating instance_info_cache with network_info: [{"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-b7db09b0-7889-4436-ba6a-6ed1a544c2b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-85218b7b-7025-40fd-98ca-36880f0ac155 req-26ea2002-eec4-4ce8-b993-f425cf68d788 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-unplugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-85218b7b-7025-40fd-98ca-36880f0ac155 req-26ea2002-eec4-4ce8-b993-f425cf68d788 service nova] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-85218b7b-7025-40fd-98ca-36880f0ac155 req-26ea2002-eec4-4ce8-b993-f425cf68d788 service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-85218b7b-7025-40fd-98ca-36880f0ac155 req-26ea2002-eec4-4ce8-b993-f425cf68d788 service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-85218b7b-7025-40fd-98ca-36880f0ac155 req-26ea2002-eec4-4ce8-b993-f425cf68d788 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] No waiting events found dispatching network-vif-unplugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:11 user nova-compute[74241]: WARNING nova.compute.manager [req-85218b7b-7025-40fd-98ca-36880f0ac155 req-26ea2002-eec4-4ce8-b993-f425cf68d788 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received unexpected event network-vif-unplugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 for instance with vm_state active and task_state reboot_started.
Oct 20 11:58:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Instance shutdown successfully.
Oct 20 11:58:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-1674022a-b0a5-41cf-9fdd-ef6b9f5c6619 req-c3afede3-12aa-4cea-9612-607bd21d7ea4 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1674022a-b0a5-41cf-9fdd-ef6b9f5c6619 req-c3afede3-12aa-4cea-9612-607bd21d7ea4 service nova] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1674022a-b0a5-41cf-9fdd-ef6b9f5c6619 req-c3afede3-12aa-4cea-9612-607bd21d7ea4 service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1674022a-b0a5-41cf-9fdd-ef6b9f5c6619 req-c3afede3-12aa-4cea-9612-607bd21d7ea4 service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-1674022a-b0a5-41cf-9fdd-ef6b9f5c6619 req-c3afede3-12aa-4cea-9612-607bd21d7ea4 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] No waiting events found dispatching network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:13 user nova-compute[74241]: WARNING nova.compute.manager [req-1674022a-b0a5-41cf-9fdd-ef6b9f5c6619 req-c3afede3-12aa-4cea-9612-607bd21d7ea4 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received unexpected event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 for instance with vm_state active and task_state reboot_started.
Oct 20 11:58:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:15 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 600dfdc0-0486-47bc-aeba-be1ae265462f is timed out.
Oct 20 11:58:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Successfully detached device vdb from instance 600dfdc0-0486-47bc-aeba-be1ae265462f from the live domain config.
Oct 20 11:58:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxyiQKTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:58:15 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad54332-5d91-4a62-aa6a-c46b2ae0dc22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:58:15 user nova-compute[74241]: No targets found.
Oct 20 11:58:15 user nova-compute[74241]: iSNS:
Oct 20 11:58:15 user nova-compute[74241]: No targets found.
Oct 20 11:58:15 user nova-compute[74241]: STATIC:
Oct 20 11:58:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6
Oct 20 11:58:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:58:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:58:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:58:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:58:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:58:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201
Oct 20 11:58:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:58:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:58:15 user nova-compute[74241]: FIRMWARE:
Oct 20 11:58:15 user nova-compute[74241]: No targets found.
Oct 20 11:58:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:58:15 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:58:15 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcbc881-8795-4d03-b7fe-13d3a6129e3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12d4c97-68af-4f03-a318-d7f94b6f3681]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:58:15 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:58:15 user nova-compute[74241]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)
Oct 20 11:58:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:58:15 user nova-compute[74241]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 (non-flash)
Oct 20 11:58:15 user nova-compute[74241]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)
Oct 20 11:58:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52283b6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Instance running successfully.
Oct 20 11:58:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Instance soft rebooted successfully.
Oct 20 11:58:15 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca246cb-aebe-4eb9-b266-a47b2618791c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] No waiting events found dispatching network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:15 user nova-compute[74241]: WARNING nova.compute.manager [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received unexpected event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 for instance with vm_state active and task_state reboot_started.
Oct 20 11:58:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] No waiting events found dispatching network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:15 user nova-compute[74241]: WARNING nova.compute.manager [req-b81d91ab-ed6b-4c85-bb18-871190227c4a req-fb0a56ed-00f0-4537-8039-9337f7f85f4c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received unexpected event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 for instance with vm_state active and task_state reboot_started.
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce101ac-eb0b-4f38-bfa9-12c63d50af61]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dfb1c5-48eb-4b34-b3ee-dc47f89606a9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f0b7105a-0af2-48c4-84c8-a0b285a62f8b tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.631s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c7966e-cc28-4b1f-8ade-49807deb30e6]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec574cf-ef0f-46cc-ae85-fdb5d4ae76fd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9f7d10-72e7-4133-aaca-e00e320c5506]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6, portal: 172.16.0.220,3260]
Oct 20 11:58:15 user nova-compute[74241]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6, portal: 172.16.0.220,3260] successful.
Oct 20 11:58:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3024c18f-97cd-4709-9e20-b78442e753a5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] <== disconnect_volume: return (343ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 11:58:16 user nova-compute[74241]: INFO nova.compute.claims [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Claim successful on node user
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 11:58:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.policy [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c611c28a9264820a26f203045040420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f8151a0cf44b2d89838da474c2dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 11:58:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Creating image(s)
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "/opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "/opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk 1073741824" returned: 0 in 0.049s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.226s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Successfully created port: df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Cannot resize image /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Ensure instance console log exists: /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Successfully updated port: df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 11:58:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:58:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquired lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:58:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 11:58:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-3e66b152-f1c6-467c-995c-4d7573f2413b req-016a1c4e-56bc-4a72-8e94-0992e9a844a1 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received event network-changed-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-3e66b152-f1c6-467c-995c-4d7573f2413b req-016a1c4e-56bc-4a72-8e94-0992e9a844a1 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Refreshing instance network info cache due to event network-changed-df35f627-1cec-4985-8660-113106363b55. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 11:58:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3e66b152-f1c6-467c-995c-4d7573f2413b req-016a1c4e-56bc-4a72-8e94-0992e9a844a1 service nova] Acquiring lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:58:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Updating instance_info_cache with network_info: [{"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Releasing lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Instance network_info: |[{"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3e66b152-f1c6-467c-995c-4d7573f2413b req-016a1c4e-56bc-4a72-8e94-0992e9a844a1 service nova] Acquired lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-3e66b152-f1c6-467c-995c-4d7573f2413b req-016a1c4e-56bc-4a72-8e94-0992e9a844a1 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Refreshing network info cache for port df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Start _get_guest_xml network_info=[{"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 11:58:19 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:58:19 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714721487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714721487',id=38,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-hhup83ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:58:17Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:2b:37,bridge_name='br-int',has_traffic_filtering=True,id=df35f627-1cec-4985-8660-113106363b55,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf35f627-1c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'pci_devices' on Instance uuid fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] End _get_guest_xml xml=<domain type="kvm">
Oct 20 11:58:19 user nova-compute[74241]:   <uuid>fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94</uuid>
Oct 20 11:58:19 user nova-compute[74241]:   <name>instance-00000026</name>
Oct 20 11:58:19 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 11:58:19 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 11:58:19 user nova-compute[74241]:   <metadata>
Oct 20 11:58:19 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 11:58:19 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 11:58:19 user nova-compute[74241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-714721487</nova:name>
Oct 20 11:58:19 user nova-compute[74241]:       <nova:creationTime>2023-10-20 11:58:19</nova:creationTime>
Oct 20 11:58:19 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 11:58:19 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 11:58:19 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 11:58:19 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 11:58:19 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 11:58:19 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 11:58:19 user nova-compute[74241]:       </nova:flavor>
Oct 20 11:58:19 user nova-compute[74241]:       <nova:owner>
Oct 20 11:58:19 user nova-compute[74241]:         <nova:user uuid="0c611c28a9264820a26f203045040420">tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member</nova:user>
Oct 20 11:58:19 user nova-compute[74241]:         <nova:project uuid="52f8151a0cf44b2d89838da474c2dc68">tempest-ServerBootFromVolumeStableRescueTest-929360393</nova:project>
Oct 20 11:58:19 user nova-compute[74241]:       </nova:owner>
Oct 20 11:58:19 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 11:58:19 user nova-compute[74241]:       <nova:ports>
Oct 20 11:58:19 user nova-compute[74241]:         <nova:port uuid="df35f627-1cec-4985-8660-113106363b55">
Oct 20 11:58:19 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 11:58:19 user nova-compute[74241]:         </nova:port>
Oct 20 11:58:19 user nova-compute[74241]:       </nova:ports>
Oct 20 11:58:19 user nova-compute[74241]:     </nova:instance>
Oct 20 11:58:19 user nova-compute[74241]:   </metadata>
Oct 20 11:58:19 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 11:58:19 user nova-compute[74241]:     <system>
Oct 20 11:58:19 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 11:58:19 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 11:58:19 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 11:58:19 user nova-compute[74241]:       <entry name="serial">fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94</entry>
Oct 20 11:58:19 user nova-compute[74241]:       <entry name="uuid">fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94</entry>
Oct 20 11:58:19 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 11:58:19 user nova-compute[74241]:     </system>
Oct 20 11:58:19 user nova-compute[74241]:   </sysinfo>
Oct 20 11:58:19 user nova-compute[74241]:   <os>
Oct 20 11:58:19 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 11:58:19 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 11:58:19 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 11:58:19 user nova-compute[74241]:   </os>
Oct 20 11:58:19 user nova-compute[74241]:   <features>
Oct 20 11:58:19 user nova-compute[74241]:     <acpi/>
Oct 20 11:58:19 user nova-compute[74241]:     <apic/>
Oct 20 11:58:19 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 11:58:19 user nova-compute[74241]:   </features>
Oct 20 11:58:19 user nova-compute[74241]:   <clock offset="utc">
Oct 20 11:58:19 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 11:58:19 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 11:58:19 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 11:58:19 user nova-compute[74241]:   </clock>
Oct 20 11:58:19 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 11:58:19 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 11:58:19 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 11:58:19 user nova-compute[74241]:   </cpu>
Oct 20 11:58:19 user nova-compute[74241]:   <devices>
Oct 20 11:58:19 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 11:58:19 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 11:58:19 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk"/>
Oct 20 11:58:19 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 11:58:19 user nova-compute[74241]:     </disk>
Oct 20 11:58:19 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 11:58:19 user nova-compute[74241]:       <mac address="fa:16:3e:ee:2b:37"/>
Oct 20 11:58:19 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:58:19 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 11:58:19 user nova-compute[74241]:       <target dev="tapdf35f627-1c"/>
Oct 20 11:58:19 user nova-compute[74241]:     </interface>
Oct 20 11:58:19 user nova-compute[74241]:     <serial type="pty">
Oct 20 11:58:19 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/console.log" append="off"/>
Oct 20 11:58:19 user nova-compute[74241]:     </serial>
Oct 20 11:58:19 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 11:58:19 user nova-compute[74241]:     <video>
Oct 20 11:58:19 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 11:58:19 user nova-compute[74241]:     </video>
Oct 20 11:58:19 user nova-compute[74241]:     <rng model="virtio">
Oct 20 11:58:19 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 11:58:19 user nova-compute[74241]:     </rng>
Oct 20 11:58:19 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 11:58:19 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 11:58:19 user nova-compute[74241]:       <stats period="10"/>
Oct 20 11:58:19 user nova-compute[74241]:     </memballoon>
Oct 20 11:58:19 user nova-compute[74241]:   </devices>
Oct 20 11:58:19 user nova-compute[74241]: </domain>
Oct 20 11:58:19 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714721487',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714721487',id=38,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-hhup83ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T11:58:17Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:2b:37,bridge_name='br-int',has_traffic_filtering=True,id=df35f627-1cec-4985-8660-113106363b55,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf35f627-1c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG os_vif [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:2b:37,bridge_name='br-int',has_traffic_filtering=True,id=df35f627-1cec-4985-8660-113106363b55,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf35f627-1c') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8f6cd5a-714c-5216-9eb0-6e752da9b9f1', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf35f627-1c, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf35f627-1c, col_values=(('qos', UUID('6439c409-e7cf-4b90-92df-83f32e4559c8')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf35f627-1c, col_values=(('external_ids', {'iface-id': 'df35f627-1cec-4985-8660-113106363b55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:2b:37', 'vm-uuid': 'fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:19 user nova-compute[74241]: INFO os_vif [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:2b:37,bridge_name='br-int',has_traffic_filtering=True,id=df35f627-1cec-4985-8660-113106363b55,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf35f627-1c')
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No VIF found with MAC fa:16:3e:ee:2b:37, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-3e66b152-f1c6-467c-995c-4d7573f2413b req-016a1c4e-56bc-4a72-8e94-0992e9a844a1 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Updated VIF entry in instance network info cache for port df35f627-1cec-4985-8660-113106363b55. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-3e66b152-f1c6-467c-995c-4d7573f2413b req-016a1c4e-56bc-4a72-8e94-0992e9a844a1 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Updating instance_info_cache with network_info: [{"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3e66b152-f1c6-467c-995c-4d7573f2413b req-016a1c4e-56bc-4a72-8e94-0992e9a844a1 service nova] Releasing lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'flavor' on Instance uuid 600dfdc0-0486-47bc-aeba-be1ae265462f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-9923b65e-35bc-49ce-933e-55427686738f tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.115s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 25.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:20 user nova-compute[74241]: INFO nova.compute.manager [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Terminating instance
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-6f43d3bb-e935-4d70-ae74-3670c897878c req-be318bff-4979-4d43-ac59-e33dc9b90cb0 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received event network-vif-unplugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f43d3bb-e935-4d70-ae74-3670c897878c req-be318bff-4979-4d43-ac59-e33dc9b90cb0 service nova] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f43d3bb-e935-4d70-ae74-3670c897878c req-be318bff-4979-4d43-ac59-e33dc9b90cb0 service nova] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6f43d3bb-e935-4d70-ae74-3670c897878c req-be318bff-4979-4d43-ac59-e33dc9b90cb0 service nova] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-6f43d3bb-e935-4d70-ae74-3670c897878c req-be318bff-4979-4d43-ac59-e33dc9b90cb0 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] No waiting events found dispatching network-vif-unplugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-6f43d3bb-e935-4d70-ae74-3670c897878c req-be318bff-4979-4d43-ac59-e33dc9b90cb0 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received event network-vif-unplugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:58:20 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Instance destroyed successfully.
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lazy-loading 'resources' on Instance uuid 600dfdc0-0486-47bc-aeba-be1ae265462f {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:54:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-298331357',display_name='tempest-VolumesSnapshotTestJSON-instance-298331357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-298331357',id=35,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZ8/oWLiEGEaMy88eZK7OfbmbJkz1Snyy1oend+H0zgs1LNCPDH4LNLtkspA2aFWwRBO8MFykQKkAEbLfXH2WMSxr8xtSehI5ln2VxEPG4ZTblNF9g84oCXye1ztUDo/Q==',key_name='tempest-keypair-72918536',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:54:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4764e42940fd415986f661c0abfe5e5b',ramdisk_id='',reservation_id='r-5vjcmixi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-740119974',owner_user_name='tempest-VolumesSnapshotTestJSON-740119974-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:54:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4f1fe587313141b488e5975c3e72c571',uuid=600dfdc0-0486-47bc-aeba-be1ae265462f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converting VIF {"id": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "address": "fa:16:3e:31:4d:a6", "network": {"id": "24d01ac6-c5ca-47f8-a381-085c84c505fe", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2000908310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4764e42940fd415986f661c0abfe5e5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6671c30e-b5", "ovs_interfaceid": "6671c30e-b5a1-4079-b5a6-d9a1df748a54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:4d:a6,bridge_name='br-int',has_traffic_filtering=True,id=6671c30e-b5a1-4079-b5a6-d9a1df748a54,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6671c30e-b5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG os_vif [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:4d:a6,bridge_name='br-int',has_traffic_filtering=True,id=6671c30e-b5a1-4079-b5a6-d9a1df748a54,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6671c30e-b5') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6671c30e-b5, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffafcd1e-944c-45b9-9b63-b2c607c7e278) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:20 user nova-compute[74241]: INFO os_vif [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:4d:a6,bridge_name='br-int',has_traffic_filtering=True,id=6671c30e-b5a1-4079-b5a6-d9a1df748a54,network=Network(24d01ac6-c5ca-47f8-a381-085c84c505fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6671c30e-b5')
Oct 20 11:58:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uxyiQKTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 11:58:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 11:58:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1cdd5c-7396-4097-9ef8-ca145185a8c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 11:58:20 user nova-compute[74241]: No targets found.
Oct 20 11:58:20 user nova-compute[74241]: iSNS:
Oct 20 11:58:20 user nova-compute[74241]: No targets found.
Oct 20 11:58:20 user nova-compute[74241]: STATIC:
Oct 20 11:58:20 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 11:58:20 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:58:20 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:58:20 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201
Oct 20 11:58:20 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 11:58:20 user nova-compute[74241]:                 Iface Name: default
Oct 20 11:58:20 user nova-compute[74241]: FIRMWARE:
Oct 20 11:58:20 user nova-compute[74241]: No targets found.
Oct 20 11:58:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:58:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 11:58:20 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 11:58:20 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:065869a1-8d4f-4b13-a476-5068a812a1b6', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd9d89-57b3-44a5-b165-bb7348d32aa4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2703ad-f8ee-4318-b1d7-b9f94c553da1]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:58:21 user nova-compute[74241]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)
Oct 20 11:58:21 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 11:58:21 user nova-compute[74241]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)
Oct 20 11:58:21 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5208655000>, {}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Disconnecting from: [] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] <== disconnect_volume: return (85ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 11:58:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Deleting instance files /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f_del
Oct 20 11:58:21 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Deletion of /opt/stack/data/nova/instances/600dfdc0-0486-47bc-aeba-be1ae265462f_del complete
Oct 20 11:58:21 user nova-compute[74241]: INFO nova.compute.manager [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-cfb87145-578a-4a81-9404-52b70719556e req-40237ed0-3f6a-41f1-82a3-ed00e080cedf service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received event network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cfb87145-578a-4a81-9404-52b70719556e req-40237ed0-3f6a-41f1-82a3-ed00e080cedf service nova] Acquiring lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cfb87145-578a-4a81-9404-52b70719556e req-40237ed0-3f6a-41f1-82a3-ed00e080cedf service nova] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cfb87145-578a-4a81-9404-52b70719556e req-40237ed0-3f6a-41f1-82a3-ed00e080cedf service nova] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-cfb87145-578a-4a81-9404-52b70719556e req-40237ed0-3f6a-41f1-82a3-ed00e080cedf service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] No waiting events found dispatching network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:21 user nova-compute[74241]: WARNING nova.compute.manager [req-cfb87145-578a-4a81-9404-52b70719556e req-40237ed0-3f6a-41f1-82a3-ed00e080cedf service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received unexpected event network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 for instance with vm_state building and task_state spawning.
Oct 20 11:58:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:22 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Took 1.23 seconds to deallocate network for instance.
Oct 20 11:58:22 user nova-compute[74241]: WARNING nova.volume.cinder [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Attachment 556faf62-2bc6-4981-a618-f53db8f75ce9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 556faf62-2bc6-4981-a618-f53db8f75ce9. (HTTP 404) (Request-ID: req-1ae729b1-f6f4-471f-bc2b-1c3523139d38)
Oct 20 11:58:22 user nova-compute[74241]: INFO nova.compute.manager [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Took 0.05 seconds to detach 1 volumes for instance.
Oct 20 11:58:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-accc684d-36cb-4ede-b372-0688441c87c2 req-49aa055b-06b2-40dd-88ce-62e5ab204905 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received event network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-accc684d-36cb-4ede-b372-0688441c87c2 req-49aa055b-06b2-40dd-88ce-62e5ab204905 service nova] Acquiring lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-accc684d-36cb-4ede-b372-0688441c87c2 req-49aa055b-06b2-40dd-88ce-62e5ab204905 service nova] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-accc684d-36cb-4ede-b372-0688441c87c2 req-49aa055b-06b2-40dd-88ce-62e5ab204905 service nova] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-accc684d-36cb-4ede-b372-0688441c87c2 req-49aa055b-06b2-40dd-88ce-62e5ab204905 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] No waiting events found dispatching network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:22 user nova-compute[74241]: WARNING nova.compute.manager [req-accc684d-36cb-4ede-b372-0688441c87c2 req-49aa055b-06b2-40dd-88ce-62e5ab204905 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received unexpected event network-vif-plugged-6671c30e-b5a1-4079-b5a6-d9a1df748a54 for instance with vm_state deleted and task_state None.
Oct 20 11:58:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-accc684d-36cb-4ede-b372-0688441c87c2 req-49aa055b-06b2-40dd-88ce-62e5ab204905 service nova] [instance: 600dfdc0-0486-47bc-aeba-be1ae265462f] Received event network-vif-deleted-6671c30e-b5a1-4079-b5a6-d9a1df748a54 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:58:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:22 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Deleted allocations for instance 600dfdc0-0486-47bc-aeba-be1ae265462f
Oct 20 11:58:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e8aed38e-ad80-47a1-8d3b-14b00e4ca460 tempest-VolumesSnapshotTestJSON-740119974 tempest-VolumesSnapshotTestJSON-740119974-project-member] Lock "600dfdc0-0486-47bc-aeba-be1ae265462f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.021s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-6792c0d0-e69b-406c-9f28-91ef7d5932f2 req-6425bcce-e7de-42da-b57f-f4c265f68791 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received event network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6792c0d0-e69b-406c-9f28-91ef7d5932f2 req-6425bcce-e7de-42da-b57f-f4c265f68791 service nova] Acquiring lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6792c0d0-e69b-406c-9f28-91ef7d5932f2 req-6425bcce-e7de-42da-b57f-f4c265f68791 service nova] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6792c0d0-e69b-406c-9f28-91ef7d5932f2 req-6425bcce-e7de-42da-b57f-f4c265f68791 service nova] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-6792c0d0-e69b-406c-9f28-91ef7d5932f2 req-6425bcce-e7de-42da-b57f-f4c265f68791 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] No waiting events found dispatching network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:23 user nova-compute[74241]: WARNING nova.compute.manager [req-6792c0d0-e69b-406c-9f28-91ef7d5932f2 req-6425bcce-e7de-42da-b57f-f4c265f68791 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received unexpected event network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 for instance with vm_state building and task_state spawning.
Oct 20 11:58:23 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 11:58:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 11:58:24 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Instance spawned successfully.
Oct 20 11:58:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 11:58:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:58:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:58:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:58:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:58:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:58:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 11:58:24 user nova-compute[74241]: INFO nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Took 7.15 seconds to spawn the instance on the hypervisor.
Oct 20 11:58:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 11:58:24 user nova-compute[74241]: INFO nova.compute.manager [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Took 8.03 seconds to build instance.
Oct 20 11:58:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f16a4fc4-a436-401e-9ad8-158052ad6b48 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.126s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:34 user nova-compute[74241]: INFO nova.compute.manager [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Terminating instance
Oct 20 11:58:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Instance destroyed successfully.
Oct 20 11:58:34 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lazy-loading 'resources' on Instance uuid 5a7e6673-27d4-426f-94ad-28b998c9113d {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-a0d0e55d-bf77-46cb-9a41-9c9bb7edffcb req-24f4203e-1aa6-421d-86e8-e78ef9c89f6e service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-unplugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a0d0e55d-bf77-46cb-9a41-9c9bb7edffcb req-24f4203e-1aa6-421d-86e8-e78ef9c89f6e service nova] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a0d0e55d-bf77-46cb-9a41-9c9bb7edffcb req-24f4203e-1aa6-421d-86e8-e78ef9c89f6e service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a0d0e55d-bf77-46cb-9a41-9c9bb7edffcb req-24f4203e-1aa6-421d-86e8-e78ef9c89f6e service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-a0d0e55d-bf77-46cb-9a41-9c9bb7edffcb req-24f4203e-1aa6-421d-86e8-e78ef9c89f6e service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] No waiting events found dispatching network-vif-unplugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-a0d0e55d-bf77-46cb-9a41-9c9bb7edffcb req-24f4203e-1aa6-421d-86e8-e78ef9c89f6e service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-unplugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:56:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-272858478',display_name='tempest-VolumesNegativeTest-instance-272858478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-272858478',id=37,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:56:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77cfe58431034fac8204fdc8bbfbde09',ramdisk_id='',reservation_id='r-dcyyszd7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1527527333',owner_user_name='tempest-VolumesNegativeTest-1527527333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:56:51Z,user_data=None,user_id='4e8492d48fb64b67a61b253a5119a8d5',uuid=5a7e6673-27d4-426f-94ad-28b998c9113d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Converting VIF {"id": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "address": "fa:16:3e:0b:a9:35", "network": {"id": "55a61d37-fa07-4499-b186-4a96ed57fdcc", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.251", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "0d78ec999c304667aab045a629f8a22b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba5d7f9e-0d", "ovs_interfaceid": "ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a9:35,bridge_name='br-int',has_traffic_filtering=True,id=ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775,network=Network(55a61d37-fa07-4499-b186-4a96ed57fdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba5d7f9e-0d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG os_vif [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a9:35,bridge_name='br-int',has_traffic_filtering=True,id=ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775,network=Network(55a61d37-fa07-4499-b186-4a96ed57fdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba5d7f9e-0d') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba5d7f9e-0d, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be972775-723f-4b6e-a80b-3e2a2218334d) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:58:34 user nova-compute[74241]: INFO os_vif [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:a9:35,bridge_name='br-int',has_traffic_filtering=True,id=ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775,network=Network(55a61d37-fa07-4499-b186-4a96ed57fdcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba5d7f9e-0d')
Oct 20 11:58:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Deleting instance files /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d_del
Oct 20 11:58:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Deletion of /opt/stack/data/nova/instances/5a7e6673-27d4-426f-94ad-28b998c9113d_del complete
Oct 20 11:58:35 user nova-compute[74241]: INFO nova.compute.manager [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Took 0.82 seconds to destroy the instance on the hypervisor.
Oct 20 11:58:35 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG nova.compute.manager [req-bf2e92ae-0951-4d3b-a85c-abba814484e8 req-38354a35-e6ad-49f6-a66c-c0fd21eaf81f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-deleted-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:35 user nova-compute[74241]: INFO nova.compute.manager [req-bf2e92ae-0951-4d3b-a85c-abba814484e8 req-38354a35-e6ad-49f6-a66c-c0fd21eaf81f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Neutron deleted interface ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775; detaching it from the instance and deleting it from the info cache
Oct 20 11:58:35 user nova-compute[74241]: DEBUG nova.network.neutron [req-bf2e92ae-0951-4d3b-a85c-abba814484e8 req-38354a35-e6ad-49f6-a66c-c0fd21eaf81f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:58:35 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Took 0.71 seconds to deallocate network for instance.
Oct 20 11:58:35 user nova-compute[74241]: DEBUG nova.compute.manager [req-bf2e92ae-0951-4d3b-a85c-abba814484e8 req-38354a35-e6ad-49f6-a66c-c0fd21eaf81f service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Detach interface failed, port_id=ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775, reason: Instance 5a7e6673-27d4-426f-94ad-28b998c9113d could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:36 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Deleted allocations for instance 5a7e6673-27d4-426f-94ad-28b998c9113d
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f48127b7-bd17-40b3-99ab-a538ed47e531 tempest-VolumesNegativeTest-1527527333 tempest-VolumesNegativeTest-1527527333-project-member] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.079s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] No waiting events found dispatching network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:36 user nova-compute[74241]: WARNING nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received unexpected event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 for instance with vm_state deleted and task_state None.
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] No waiting events found dispatching network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:36 user nova-compute[74241]: WARNING nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received unexpected event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 for instance with vm_state deleted and task_state None.
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] No waiting events found dispatching network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:36 user nova-compute[74241]: WARNING nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received unexpected event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 for instance with vm_state deleted and task_state None.
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-unplugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] No waiting events found dispatching network-vif-unplugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:36 user nova-compute[74241]: WARNING nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received unexpected event network-vif-unplugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 for instance with vm_state deleted and task_state None.
Oct 20 11:58:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:58:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Acquiring lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:58:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:58:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] Lock "5a7e6673-27d4-426f-94ad-28b998c9113d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:58:37 user nova-compute[74241]: DEBUG nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] No waiting events found dispatching network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:58:37 user nova-compute[74241]: WARNING nova.compute.manager [req-706f7990-7e9d-42cc-8732-facb9566a20c req-27cdf8b2-f612-4b65-a3b7-379387c1a669 service nova] [instance: 5a7e6673-27d4-426f-94ad-28b998c9113d] Received unexpected event network-vif-plugged-ba5d7f9e-0dbb-4650-b6c6-3fcfdc9dc775 for instance with vm_state deleted and task_state None.
Oct 20 11:58:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:58:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:02 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:04 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:59:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:59:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:59:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 11:59:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.419s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 11:59:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 11:59:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 11:59:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:59:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8227MB free_disk=25.163387298583984GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 031a2001-57b8-4411-bed1-69eac953d40b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.602s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 11:59:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 11:59:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 11:59:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 11:59:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 11:59:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 11:59:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updating instance_info_cache with network_info: [{"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:59:11 user nova-compute[74241]: INFO nova.compute.manager [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Terminating instance
Oct 20 11:59:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-5640bc1c-dfea-4cb8-8210-cbcdd5ce7f0f req-d32328d5-8bbd-49e2-b6dc-7bd997b51915 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-unplugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5640bc1c-dfea-4cb8-8210-cbcdd5ce7f0f req-d32328d5-8bbd-49e2-b6dc-7bd997b51915 service nova] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5640bc1c-dfea-4cb8-8210-cbcdd5ce7f0f req-d32328d5-8bbd-49e2-b6dc-7bd997b51915 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5640bc1c-dfea-4cb8-8210-cbcdd5ce7f0f req-d32328d5-8bbd-49e2-b6dc-7bd997b51915 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-5640bc1c-dfea-4cb8-8210-cbcdd5ce7f0f req-d32328d5-8bbd-49e2-b6dc-7bd997b51915 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] No waiting events found dispatching network-vif-unplugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:59:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-5640bc1c-dfea-4cb8-8210-cbcdd5ce7f0f req-d32328d5-8bbd-49e2-b6dc-7bd997b51915 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-unplugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Instance destroyed successfully.
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'resources' on Instance uuid b7db09b0-7889-4436-ba6a-6ed1a544c2b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1970612555',display_name='tempest-ServerRescueNegativeTestJSON-server-1970612555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1970612555',id=21,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:44:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-gw13birt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:44:06Z,user_data=None,user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=b7db09b0-7889-4436-ba6a-6ed1a544c2b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "address": "fa:16:3e:14:f2:85", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204f624b-c2", "ovs_interfaceid": "204f624b-c2b4-4e64-a2dd-23970b13fb6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:f2:85,bridge_name='br-int',has_traffic_filtering=True,id=204f624b-c2b4-4e64-a2dd-23970b13fb6b,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204f624b-c2') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG os_vif [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:f2:85,bridge_name='br-int',has_traffic_filtering=True,id=204f624b-c2b4-4e64-a2dd-23970b13fb6b,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204f624b-c2') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap204f624b-c2, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cc671072-4263-45dd-8015-0379c54d04f3) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:12 user nova-compute[74241]: INFO os_vif [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:f2:85,bridge_name='br-int',has_traffic_filtering=True,id=204f624b-c2b4-4e64-a2dd-23970b13fb6b,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204f624b-c2')
Oct 20 11:59:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Deleting instance files /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5_del
Oct 20 11:59:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Deletion of /opt/stack/data/nova/instances/b7db09b0-7889-4436-ba6a-6ed1a544c2b5_del complete
Oct 20 11:59:12 user nova-compute[74241]: INFO nova.compute.manager [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 11:59:12 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-44142cba-f6b9-4760-9344-7a68c2254b00 req-1b8d680f-1141-44de-8bf1-a64fe552ce98 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-deleted-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:59:12 user nova-compute[74241]: INFO nova.compute.manager [req-44142cba-f6b9-4760-9344-7a68c2254b00 req-1b8d680f-1141-44de-8bf1-a64fe552ce98 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Neutron deleted interface 204f624b-c2b4-4e64-a2dd-23970b13fb6b; detaching it from the instance and deleting it from the info cache
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.network.neutron [req-44142cba-f6b9-4760-9344-7a68c2254b00 req-1b8d680f-1141-44de-8bf1-a64fe552ce98 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 11:59:12 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Took 0.51 seconds to deallocate network for instance.
Oct 20 11:59:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-44142cba-f6b9-4760-9344-7a68c2254b00 req-1b8d680f-1141-44de-8bf1-a64fe552ce98 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Detach interface failed, port_id=204f624b-c2b4-4e64-a2dd-23970b13fb6b, reason: Instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:59:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:59:13 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 11:59:13 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 11:59:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:59:13 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Deleted allocations for instance b7db09b0-7889-4436-ba6a-6ed1a544c2b5
Oct 20 11:59:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a9fa7e10-dd0f-475a-a9ab-380bcd174405 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.818s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:59:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-1bfda0be-3960-42d8-ba0b-16e76449f141 req-571d5595-eb70-45e1-9c77-7b1f800e7045 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 11:59:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bfda0be-3960-42d8-ba0b-16e76449f141 req-571d5595-eb70-45e1-9c77-7b1f800e7045 service nova] Acquiring lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 11:59:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bfda0be-3960-42d8-ba0b-16e76449f141 req-571d5595-eb70-45e1-9c77-7b1f800e7045 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 11:59:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1bfda0be-3960-42d8-ba0b-16e76449f141 req-571d5595-eb70-45e1-9c77-7b1f800e7045 service nova] Lock "b7db09b0-7889-4436-ba6a-6ed1a544c2b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 11:59:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-1bfda0be-3960-42d8-ba0b-16e76449f141 req-571d5595-eb70-45e1-9c77-7b1f800e7045 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] No waiting events found dispatching network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 11:59:13 user nova-compute[74241]: WARNING nova.compute.manager [req-1bfda0be-3960-42d8-ba0b-16e76449f141 req-571d5595-eb70-45e1-9c77-7b1f800e7045 service nova] [instance: b7db09b0-7889-4436-ba6a-6ed1a544c2b5] Received unexpected event network-vif-plugged-204f624b-c2b4-4e64-a2dd-23970b13fb6b for instance with vm_state deleted and task_state None.
Oct 20 11:59:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:59:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 11:59:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 11:59:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:59:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 11:59:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 11:59:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 11:59:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-ba067939-5d94-444b-b7e6-58d23f827221 req-d099419a-7b65-4bea-b8be-76f62b1328dd service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-ba067939-5d94-444b-b7e6-58d23f827221 req-d099419a-7b65-4bea-b8be-76f62b1328dd service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing instance network info cache due to event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:00:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ba067939-5d94-444b-b7e6-58d23f827221 req-d099419a-7b65-4bea-b8be-76f62b1328dd service nova] Acquiring lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ba067939-5d94-444b-b7e6-58d23f827221 req-d099419a-7b65-4bea-b8be-76f62b1328dd service nova] Acquired lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-ba067939-5d94-444b-b7e6-58d23f827221 req-d099419a-7b65-4bea-b8be-76f62b1328dd service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:00:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-ba067939-5d94-444b-b7e6-58d23f827221 req-d099419a-7b65-4bea-b8be-76f62b1328dd service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updated VIF entry in instance network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:00:01 user nova-compute[74241]: DEBUG nova.network.neutron [req-ba067939-5d94-444b-b7e6-58d23f827221 req-d099419a-7b65-4bea-b8be-76f62b1328dd service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ba067939-5d94-444b-b7e6-58d23f827221 req-d099419a-7b65-4bea-b8be-76f62b1328dd service nova] Releasing lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-63d3194b-6d88-47d8-aaca-1a7875a781f4 req-868b948d-170a-4c13-b93f-409a8b0c0c13 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-63d3194b-6d88-47d8-aaca-1a7875a781f4 req-868b948d-170a-4c13-b93f-409a8b0c0c13 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing instance network info cache due to event network-changed-2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:00:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63d3194b-6d88-47d8-aaca-1a7875a781f4 req-868b948d-170a-4c13-b93f-409a8b0c0c13 service nova] Acquiring lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63d3194b-6d88-47d8-aaca-1a7875a781f4 req-868b948d-170a-4c13-b93f-409a8b0c0c13 service nova] Acquired lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.network.neutron [req-63d3194b-6d88-47d8-aaca-1a7875a781f4 req-868b948d-170a-4c13-b93f-409a8b0c0c13 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Refreshing network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:02 user nova-compute[74241]: INFO nova.compute.manager [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Detaching volume 627783f3-b72d-4e08-94ed-0f5478cae201
Oct 20 12:00:02 user nova-compute[74241]: INFO nova.virt.block_device [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Attempting to driver detach volume 627783f3-b72d-4e08-94ed-0f5478cae201 from mountpoint /dev/vdb
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Attempting to detach device vdb from instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:00:02 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:00:02 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:00:02 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:00:02 user nova-compute[74241]:   <serial>627783f3-b72d-4e08-94ed-0f5478cae201</serial>
Oct 20 12:00:02 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:00:02 user nova-compute[74241]: </disk>
Oct 20 12:00:02 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:00:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully detached device vdb from instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 from the persistent domain config.
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:00:02 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:00:02 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:00:02 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:00:02 user nova-compute[74241]:   <serial>627783f3-b72d-4e08-94ed-0f5478cae201</serial>
Oct 20 12:00:02 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:00:02 user nova-compute[74241]: </disk>
Oct 20 12:00:02 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "031a2001-57b8-4411-bed1-69eac953d40b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:02 user nova-compute[74241]: INFO nova.compute.manager [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Terminating instance
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.network.neutron [req-63d3194b-6d88-47d8-aaca-1a7875a781f4 req-868b948d-170a-4c13-b93f-409a8b0c0c13 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updated VIF entry in instance network info cache for port 2b385ffd-f8e8-472c-a32a-7ee2965b4932. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.network.neutron [req-63d3194b-6d88-47d8-aaca-1a7875a781f4 req-868b948d-170a-4c13-b93f-409a8b0c0c13 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [{"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63d3194b-6d88-47d8-aaca-1a7875a781f4 req-868b948d-170a-4c13-b93f-409a8b0c0c13 service nova] Releasing lock "refresh_cache-edc8a08d-60ed-46a0-a381-9c5b4af93d89" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-6587e107-a2f7-4bf1-89d0-461305033b62 req-6e3d1d04-c06b-4e87-a6ac-aee46d95afd0 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6587e107-a2f7-4bf1-89d0-461305033b62 req-6e3d1d04-c06b-4e87-a6ac-aee46d95afd0 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6587e107-a2f7-4bf1-89d0-461305033b62 req-6e3d1d04-c06b-4e87-a6ac-aee46d95afd0 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6587e107-a2f7-4bf1-89d0-461305033b62 req-6e3d1d04-c06b-4e87-a6ac-aee46d95afd0 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-6587e107-a2f7-4bf1-89d0-461305033b62 req-6e3d1d04-c06b-4e87-a6ac-aee46d95afd0 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-6587e107-a2f7-4bf1-89d0-461305033b62 req-6e3d1d04-c06b-4e87-a6ac-aee46d95afd0 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:00:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:00:03 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Instance destroyed successfully.
Oct 20 12:00:03 user nova-compute[74241]: DEBUG nova.objects.instance [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lazy-loading 'resources' on Instance uuid 031a2001-57b8-4411-bed1-69eac953d40b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:42:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1839366464',display_name='tempest-ServerRescueNegativeTestJSON-server-1839366464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1839366464',id=20,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:47:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b379f1e29f94071a26728bdb59bbfcb',ramdisk_id='',reservation_id='r-w5380cy6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1505666936',owner_user_name='tempest-ServerRescueNegativeTestJSON-1505666936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:49:00Z,user_data=None,user_id='6ad19e5d57684ea2ae450fcc53ca8bd7',uuid=031a2001-57b8-4411-bed1-69eac953d40b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converting VIF {"id": "9193aa87-6409-4548-812c-31bbc6605398", "address": "fa:16:3e:a8:7e:75", "network": {"id": "21f8ebe6-291c-4e1b-be78-723d5b476b29", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1478532837-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6b379f1e29f94071a26728bdb59bbfcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9193aa87-64", "ovs_interfaceid": "9193aa87-6409-4548-812c-31bbc6605398", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:7e:75,bridge_name='br-int',has_traffic_filtering=True,id=9193aa87-6409-4548-812c-31bbc6605398,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9193aa87-64') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG os_vif [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:7e:75,bridge_name='br-int',has_traffic_filtering=True,id=9193aa87-6409-4548-812c-31bbc6605398,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9193aa87-64') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9193aa87-64, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fc375dc-25de-400c-8a59-3a163bb361f9) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:00:03 user nova-compute[74241]: INFO os_vif [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:7e:75,bridge_name='br-int',has_traffic_filtering=True,id=9193aa87-6409-4548-812c-31bbc6605398,network=Network(21f8ebe6-291c-4e1b-be78-723d5b476b29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9193aa87-64')
Oct 20 12:00:03 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Deleting instance files /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b_del
Oct 20 12:00:03 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Deletion of /opt/stack/data/nova/instances/031a2001-57b8-4411-bed1-69eac953d40b_del complete
Oct 20 12:00:03 user nova-compute[74241]: INFO nova.compute.manager [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 20 12:00:03 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:04 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Took 0.82 seconds to deallocate network for instance.
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-69b4457c-7c1c-48d2-a96c-08e02abd7c7d req-d37766e8-afd1-46d7-ab82-4ef425348109 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-deleted-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:04 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Deleted allocations for instance 031a2001-57b8-4411-bed1-69eac953d40b
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b3d1f227-4a5d-4e74-88a8-2b766b971665 tempest-ServerRescueNegativeTestJSON-1505666936 tempest-ServerRescueNegativeTestJSON-1505666936-project-member] Lock "031a2001-57b8-4411-bed1-69eac953d40b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.605s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:04 user nova-compute[74241]: WARNING nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state deleted and task_state None.
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:04 user nova-compute[74241]: WARNING nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state deleted and task_state None.
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:04 user nova-compute[74241]: WARNING nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state deleted and task_state None.
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:04 user nova-compute[74241]: WARNING nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-unplugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state deleted and task_state None.
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Acquiring lock "031a2001-57b8-4411-bed1-69eac953d40b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] Lock "031a2001-57b8-4411-bed1-69eac953d40b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] No waiting events found dispatching network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:04 user nova-compute[74241]: WARNING nova.compute.manager [req-e05e07bb-17c6-400d-b242-26594083c14b req-964218c4-aa13-4e4a-8a9e-c4866a90d338 service nova] [instance: 031a2001-57b8-4411-bed1-69eac953d40b] Received unexpected event network-vif-plugged-9193aa87-6409-4548-812c-31bbc6605398 for instance with vm_state deleted and task_state None.
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:06 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:00:06 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:00:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.21344757080078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:00:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.744s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 48613baf-40b5-4648-a8af-6d96ab7a245b {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid edc8a08d-60ed-46a0-a381-9c5b4af93d89 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "48613baf-40b5-4648-a8af-6d96ab7a245b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:00:07 user nova-compute[74241]: INFO nova.compute.manager [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] instance snapshotting
Oct 20 12:00:07 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Beginning live snapshot process
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json -f qcow2 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:07 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:00:07 user nova-compute[74241]: INFO nova.compute.claims [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Claim successful on node user
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json -f qcow2" returned: 0 in 0.207s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json -f qcow2 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json -f qcow2" returned: 0 in 0.211s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:00:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:00:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG nova.policy [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf5346976b7f45e1b146911555f458eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6744161987c43408e35c847ec2055a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:00:08 user nova-compute[74241]: INFO nova.virt.block_device [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Booting with volume snapshot 946bc404-ee9f-4884-a18a-e5d6793bbc21 at /dev/vda
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl30vsfww/a52286dd088e4e949bc4c093be852cc6.delta 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl30vsfww/a52286dd088e4e949bc4c093be852cc6.delta 1073741824" returned: 0 in 0.063s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 12:00:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Successfully created port: 799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:00:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 12:00:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] COPY block job progress, current cursor: 40960000 final cursor: 75497472 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Successfully updated port: 799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "refresh_cache-50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquired lock "refresh_cache-50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-95a1f77e-4b88-41cd-b53a-442065aa696d req-67a7d1c6-d8f1-4fee-8fcc-0a7cae41d454 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received event network-changed-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-95a1f77e-4b88-41cd-b53a-442065aa696d req-67a7d1c6-d8f1-4fee-8fcc-0a7cae41d454 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Refreshing instance network info cache due to event network-changed-799dd78b-9e01-4e17-861b-6a63e890e08d. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95a1f77e-4b88-41cd-b53a-442065aa696d req-67a7d1c6-d8f1-4fee-8fcc-0a7cae41d454 service nova] Acquiring lock "refresh_cache-50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 12:00:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl30vsfww/a52286dd088e4e949bc4c093be852cc6.delta /opt/stack/data/nova/instances/snapshots/tmpl30vsfww/a52286dd088e4e949bc4c093be852cc6 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.network.neutron [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Updating instance_info_cache with network_info: [{"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Releasing lock "refresh_cache-50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Instance network_info: |[{"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95a1f77e-4b88-41cd-b53a-442065aa696d req-67a7d1c6-d8f1-4fee-8fcc-0a7cae41d454 service nova] Acquired lock "refresh_cache-50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:10 user nova-compute[74241]: DEBUG nova.network.neutron [req-95a1f77e-4b88-41cd-b53a-442065aa696d req-67a7d1c6-d8f1-4fee-8fcc-0a7cae41d454 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Refreshing network info cache for port 799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:00:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl30vsfww/a52286dd088e4e949bc4c093be852cc6.delta /opt/stack/data/nova/instances/snapshots/tmpl30vsfww/a52286dd088e4e949bc4c093be852cc6" returned: 0 in 0.723s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:11 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Snapshot extracted, beginning image upload
Oct 20 12:00:11 user nova-compute[74241]: DEBUG nova.network.neutron [req-95a1f77e-4b88-41cd-b53a-442065aa696d req-67a7d1c6-d8f1-4fee-8fcc-0a7cae41d454 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Updated VIF entry in instance network info cache for port 799dd78b-9e01-4e17-861b-6a63e890e08d. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:00:11 user nova-compute[74241]: DEBUG nova.network.neutron [req-95a1f77e-4b88-41cd-b53a-442065aa696d req-67a7d1c6-d8f1-4fee-8fcc-0a7cae41d454 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Updating instance_info_cache with network_info: [{"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95a1f77e-4b88-41cd-b53a-442065aa696d req-67a7d1c6-d8f1-4fee-8fcc-0a7cae41d454 service nova] Releasing lock "refresh_cache-50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:00:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:11 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:00:12 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating instance_info_cache with network_info: [{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:00:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Snapshot image upload complete
Oct 20 12:00:14 user nova-compute[74241]: INFO nova.compute.manager [None req-cc78dd0e-4b15-498f-8d85-447b863d78ee tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Took 6.47 seconds to snapshot the instance on the hypervisor.
Oct 20 12:00:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:00:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:00:16 user nova-compute[74241]: INFO nova.compute.claims [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Claim successful on node user
Oct 20 12:00:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:00:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:00:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:00:17 user nova-compute[74241]: INFO nova.virt.block_device [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Booting with volume d404e218-9f3e-4b3f-a04e-ee52ed206b74 at /dev/vda
Oct 20 12:00:17 user nova-compute[74241]: DEBUG nova.policy [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c95f4f751dd443059465a9c3daa01f52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d5e24daa11c4757afc2c27aa246d31d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG os_brick.utils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39182d3-a496-46ae-8c25-35b827d4a5b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ce4362-49df-4652-a47e-d8ceaa6b4602]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be4d126-e3b6-4d69-8ba6-2ddae70c2e60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3541ad-07d1-49cf-91c5-b2fc16fb517d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:00:17 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:00:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e974e3f-edf6-42e6-b569-f8e686b93418]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG os_brick.utils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating existing volume attachment record: 02b3bba1-af44-4d94-b8bd-b57e349f46bf {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:00:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Successfully created port: a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:00:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:00:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Successfully updated port: a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:00:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-ad788a71-8fd7-4257-9149-d62c40af6539 req-9c6235b8-46e9-48a7-b974-26b61ff56964 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-ad788a71-8fd7-4257-9149-d62c40af6539 req-9c6235b8-46e9-48a7-b974-26b61ff56964 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing instance network info cache due to event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ad788a71-8fd7-4257-9149-d62c40af6539 req-9c6235b8-46e9-48a7-b974-26b61ff56964 service nova] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG nova.network.neutron [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG nova.network.neutron [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance network_info: |[{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ad788a71-8fd7-4257-9149-d62c40af6539 req-9c6235b8-46e9-48a7-b974-26b61ff56964 service nova] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-ad788a71-8fd7-4257-9149-d62c40af6539 req-9c6235b8-46e9-48a7-b974-26b61ff56964 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-ad788a71-8fd7-4257-9149-d62c40af6539 req-9c6235b8-46e9-48a7-b974-26b61ff56964 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updated VIF entry in instance network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-ad788a71-8fd7-4257-9149-d62c40af6539 req-9c6235b8-46e9-48a7-b974-26b61ff56964 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ad788a71-8fd7-4257-9149-d62c40af6539 req-9c6235b8-46e9-48a7-b974-26b61ff56964 service nova] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:23 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 is timed out.
Oct 20 12:00:23 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully detached device vdb from instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 from the live domain config.
Oct 20 12:00:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHRAwrbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:00:23 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[192ec3a6-9fcb-47b2-b7ae-b73910171755]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:00:23 user nova-compute[74241]: No targets found.
Oct 20 12:00:23 user nova-compute[74241]: iSNS:
Oct 20 12:00:23 user nova-compute[74241]: No targets found.
Oct 20 12:00:23 user nova-compute[74241]: STATIC:
Oct 20 12:00:23 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:00:23 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:00:23 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:00:23 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201
Oct 20 12:00:23 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:00:23 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:00:23 user nova-compute[74241]: FIRMWARE:
Oct 20 12:00:23 user nova-compute[74241]: No targets found.
Oct 20 12:00:23 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:00:23 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:00:23 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1164900a-4a7c-4a9c-be2d-ec84fa1524d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fc6b5c-677e-4a67-9cc1-847cc8377d05]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:23 user nova-compute[74241]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)
Oct 20 12:00:23 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:23 user nova-compute[74241]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 (non-flash)
Oct 20 12:00:23 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52283b79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e348594c-430f-42f8-bf1a-c14916229334]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7545d20-469c-4659-9922-07825f7bda38]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d633e30-4800-464f-8e12-853554828ad3]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fab2492-deda-48a0-8262-56db4413f709]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c60924-a3d6-4097-ac27-beda62a5b3d9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbbb980-282a-4ce3-87a2-86c9148a9b49]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201, portal: 172.16.0.220,3260]
Oct 20 12:00:23 user nova-compute[74241]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201, portal: 172.16.0.220,3260] successful.
Oct 20 12:00:23 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:627783f3-b72d-4e08-94ed-0f5478cae201 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d80c0b-c794-4133-a1f9-d6b08af12212]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] <== disconnect_volume: return (331ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:00:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'flavor' on Instance uuid edc8a08d-60ed-46a0-a381-9c5b4af93d89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bf8a348d-a39e-4a9b-a3d4-15c6832d3c99 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.443s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.150s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG os_brick.utils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cf4111-3438-42b6-8010-ebbd3b422103]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b85c65-3e36-4b24-859e-fea89c81c611]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7146443c-aa03-4cf4-bc09-35b062a1d8e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5df3f-c004-4856-b58c-8da3491b5855]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:00:24 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:00:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2f5d32-21f3-49fb-b185-b6851ece38a0]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG os_brick.utils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:00:24 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Updating existing volume attachment record: 1fb1e231-7372-4b50-a73b-5d91b564253e {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:00:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:00:28 user nova-compute[74241]: INFO nova.compute.claims [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Claim successful on node user
Oct 20 12:00:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:00:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.policy [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96bd8e533fb44c298f5ef17bbbd6ef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c1d28fe5a7414ca1aa84dbd092eb26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:00:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Creating image(s)
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "/opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "/opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.201s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk 1073741824" returned: 0 in 0.050s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Successfully created port: f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.210s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Cannot resize image /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Ensure instance console log exists: /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Successfully updated port: f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquired lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-aec2e517-db41-44b0-b620-e4b82908a3a3 req-f8902e28-b066-4096-a19d-fb03258a84d1 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-changed-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-aec2e517-db41-44b0-b620-e4b82908a3a3 req-f8902e28-b066-4096-a19d-fb03258a84d1 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Refreshing instance network info cache due to event network-changed-f8d95c60-7d6f-4149-97b8-a6058f80f69b. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aec2e517-db41-44b0-b620-e4b82908a3a3 req-f8902e28-b066-4096-a19d-fb03258a84d1 service nova] Acquiring lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updating instance_info_cache with network_info: [{"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Releasing lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Instance network_info: |[{"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aec2e517-db41-44b0-b620-e4b82908a3a3 req-f8902e28-b066-4096-a19d-fb03258a84d1 service nova] Acquired lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.neutron [req-aec2e517-db41-44b0-b620-e4b82908a3a3 req-f8902e28-b066-4096-a19d-fb03258a84d1 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Refreshing network info cache for port f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Start _get_guest_xml network_info=[{"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:00:30 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:00:30 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-84834588',display_name='tempest-TestStampPattern-server-84834588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84834588',id=41,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKjNjBfodxRSr5YvavNS/uQaM3H/sSuwdLpiLie0Gc+zlYN3eiXZGDk/CPuRUr1nTvtuenQYt1ietTjwkbxk07PqaQmzMx7LgbHmAAcY8qdVSzmBI9C6xbIafIRctDz+Q==',key_name='tempest-TestStampPattern-37297663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12c1d28fe5a7414ca1aa84dbd092eb26',ramdisk_id='',reservation_id='r-ufoggsso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-372523597',owner_user_name='tempest-TestStampPattern-372523597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:00:29Z,user_data=None,user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',uuid=8c3d85a7-f4a9-4998-be6a-d50078f02658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converting VIF {"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=f8d95c60-7d6f-4149-97b8-a6058f80f69b,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d95c60-7d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.objects.instance [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c3d85a7-f4a9-4998-be6a-d50078f02658 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:00:30 user nova-compute[74241]:   <uuid>8c3d85a7-f4a9-4998-be6a-d50078f02658</uuid>
Oct 20 12:00:30 user nova-compute[74241]:   <name>instance-00000029</name>
Oct 20 12:00:30 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:00:30 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:00:30 user nova-compute[74241]:   <metadata>
Oct 20 12:00:30 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:00:30 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:00:30 user nova-compute[74241]:       <nova:name>tempest-TestStampPattern-server-84834588</nova:name>
Oct 20 12:00:30 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:00:30</nova:creationTime>
Oct 20 12:00:30 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:00:30 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:00:30 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:00:30 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:00:30 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:00:30 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:00:30 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:00:30 user nova-compute[74241]:       <nova:owner>
Oct 20 12:00:30 user nova-compute[74241]:         <nova:user uuid="96bd8e533fb44c298f5ef17bbbd6ef5b">tempest-TestStampPattern-372523597-project-member</nova:user>
Oct 20 12:00:30 user nova-compute[74241]:         <nova:project uuid="12c1d28fe5a7414ca1aa84dbd092eb26">tempest-TestStampPattern-372523597</nova:project>
Oct 20 12:00:30 user nova-compute[74241]:       </nova:owner>
Oct 20 12:00:30 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 12:00:30 user nova-compute[74241]:       <nova:ports>
Oct 20 12:00:30 user nova-compute[74241]:         <nova:port uuid="f8d95c60-7d6f-4149-97b8-a6058f80f69b">
Oct 20 12:00:30 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 12:00:30 user nova-compute[74241]:         </nova:port>
Oct 20 12:00:30 user nova-compute[74241]:       </nova:ports>
Oct 20 12:00:30 user nova-compute[74241]:     </nova:instance>
Oct 20 12:00:30 user nova-compute[74241]:   </metadata>
Oct 20 12:00:30 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:00:30 user nova-compute[74241]:     <system>
Oct 20 12:00:30 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:00:30 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:00:30 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:00:30 user nova-compute[74241]:       <entry name="serial">8c3d85a7-f4a9-4998-be6a-d50078f02658</entry>
Oct 20 12:00:30 user nova-compute[74241]:       <entry name="uuid">8c3d85a7-f4a9-4998-be6a-d50078f02658</entry>
Oct 20 12:00:30 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:00:30 user nova-compute[74241]:     </system>
Oct 20 12:00:30 user nova-compute[74241]:   </sysinfo>
Oct 20 12:00:30 user nova-compute[74241]:   <os>
Oct 20 12:00:30 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:00:30 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:00:30 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:00:30 user nova-compute[74241]:   </os>
Oct 20 12:00:30 user nova-compute[74241]:   <features>
Oct 20 12:00:30 user nova-compute[74241]:     <acpi/>
Oct 20 12:00:30 user nova-compute[74241]:     <apic/>
Oct 20 12:00:30 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:00:30 user nova-compute[74241]:   </features>
Oct 20 12:00:30 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:00:30 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:00:30 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:00:30 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:00:30 user nova-compute[74241]:   </clock>
Oct 20 12:00:30 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:00:30 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:00:30 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:00:30 user nova-compute[74241]:   </cpu>
Oct 20 12:00:30 user nova-compute[74241]:   <devices>
Oct 20 12:00:30 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:00:30 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:00:30 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk"/>
Oct 20 12:00:30 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:00:30 user nova-compute[74241]:     </disk>
Oct 20 12:00:30 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:00:30 user nova-compute[74241]:       <mac address="fa:16:3e:6c:6a:16"/>
Oct 20 12:00:30 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:00:30 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:00:30 user nova-compute[74241]:       <target dev="tapf8d95c60-7d"/>
Oct 20 12:00:30 user nova-compute[74241]:     </interface>
Oct 20 12:00:30 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:00:30 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/console.log" append="off"/>
Oct 20 12:00:30 user nova-compute[74241]:     </serial>
Oct 20 12:00:30 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:00:30 user nova-compute[74241]:     <video>
Oct 20 12:00:30 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:00:30 user nova-compute[74241]:     </video>
Oct 20 12:00:30 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:00:30 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:00:30 user nova-compute[74241]:     </rng>
Oct 20 12:00:30 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:00:30 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:00:30 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:00:30 user nova-compute[74241]:     </memballoon>
Oct 20 12:00:30 user nova-compute[74241]:   </devices>
Oct 20 12:00:30 user nova-compute[74241]: </domain>
Oct 20 12:00:30 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-84834588',display_name='tempest-TestStampPattern-server-84834588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84834588',id=41,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKjNjBfodxRSr5YvavNS/uQaM3H/sSuwdLpiLie0Gc+zlYN3eiXZGDk/CPuRUr1nTvtuenQYt1ietTjwkbxk07PqaQmzMx7LgbHmAAcY8qdVSzmBI9C6xbIafIRctDz+Q==',key_name='tempest-TestStampPattern-37297663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12c1d28fe5a7414ca1aa84dbd092eb26',ramdisk_id='',reservation_id='r-ufoggsso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-372523597',owner_user_name='tempest-TestStampPattern-372523597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:00:29Z,user_data=None,user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',uuid=8c3d85a7-f4a9-4998-be6a-d50078f02658,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converting VIF {"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=f8d95c60-7d6f-4149-97b8-a6058f80f69b,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d95c60-7d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG os_vif [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=f8d95c60-7d6f-4149-97b8-a6058f80f69b,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d95c60-7d') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbbbbc0d-0c7a-5b04-aaf3-56949b557381', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8d95c60-7d, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8d95c60-7d, col_values=(('qos', UUID('9f7241bc-cf31-4af1-8c68-a27511369ea8')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8d95c60-7d, col_values=(('external_ids', {'iface-id': 'f8d95c60-7d6f-4149-97b8-a6058f80f69b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:6a:16', 'vm-uuid': '8c3d85a7-f4a9-4998-be6a-d50078f02658'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:30 user nova-compute[74241]: INFO os_vif [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=f8d95c60-7d6f-4149-97b8-a6058f80f69b,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d95c60-7d')
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:00:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No VIF found with MAC fa:16:3e:6c:6a:16, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:00:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-aec2e517-db41-44b0-b620-e4b82908a3a3 req-f8902e28-b066-4096-a19d-fb03258a84d1 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updated VIF entry in instance network info cache for port f8d95c60-7d6f-4149-97b8-a6058f80f69b. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:00:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-aec2e517-db41-44b0-b620-e4b82908a3a3 req-f8902e28-b066-4096-a19d-fb03258a84d1 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updating instance_info_cache with network_info: [{"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:00:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-aec2e517-db41-44b0-b620-e4b82908a3a3 req-f8902e28-b066-4096-a19d-fb03258a84d1 service nova] Releasing lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb1e6420-22be-4b69-a3a1-bd7751ca0980 req-83b50a2d-5a89-46d0-a173-ea5e8bf35f51 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb1e6420-22be-4b69-a3a1-bd7751ca0980 req-83b50a2d-5a89-46d0-a173-ea5e8bf35f51 service nova] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb1e6420-22be-4b69-a3a1-bd7751ca0980 req-83b50a2d-5a89-46d0-a173-ea5e8bf35f51 service nova] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb1e6420-22be-4b69-a3a1-bd7751ca0980 req-83b50a2d-5a89-46d0-a173-ea5e8bf35f51 service nova] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb1e6420-22be-4b69-a3a1-bd7751ca0980 req-83b50a2d-5a89-46d0-a173-ea5e8bf35f51 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] No waiting events found dispatching network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:32 user nova-compute[74241]: WARNING nova.compute.manager [req-cb1e6420-22be-4b69-a3a1-bd7751ca0980 req-83b50a2d-5a89-46d0-a173-ea5e8bf35f51 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received unexpected event network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b for instance with vm_state building and task_state spawning.
Oct 20 12:00:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:00:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Instance spawned successfully.
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-3a39f228-06ed-454d-8539-ae94a3fc68db req-cce71d66-2339-4360-9aca-a1c91ec94be7 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3a39f228-06ed-454d-8539-ae94a3fc68db req-cce71d66-2339-4360-9aca-a1c91ec94be7 service nova] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3a39f228-06ed-454d-8539-ae94a3fc68db req-cce71d66-2339-4360-9aca-a1c91ec94be7 service nova] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3a39f228-06ed-454d-8539-ae94a3fc68db req-cce71d66-2339-4360-9aca-a1c91ec94be7 service nova] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-3a39f228-06ed-454d-8539-ae94a3fc68db req-cce71d66-2339-4360-9aca-a1c91ec94be7 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] No waiting events found dispatching network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:34 user nova-compute[74241]: WARNING nova.compute.manager [req-3a39f228-06ed-454d-8539-ae94a3fc68db req-cce71d66-2339-4360-9aca-a1c91ec94be7 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received unexpected event network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b for instance with vm_state building and task_state spawning.
Oct 20 12:00:34 user nova-compute[74241]: INFO nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Took 5.66 seconds to spawn the instance on the hypervisor.
Oct 20 12:00:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:00:34 user nova-compute[74241]: INFO nova.compute.manager [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Took 6.50 seconds to build instance.
Oct 20 12:00:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cb47cd16-3ca0-46eb-a2c8-9f66e2269d6e tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.617s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:00:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Creating image(s)
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Ensure instance console log exists: /opt/stack/data/nova/instances/50fc47d5-a9d7-44da-98ae-5e03eb83c3b5/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Start _get_guest_xml network_info=[{"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '1fb1e231-7372-4b50-a73b-5d91b564253e', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EknUAxjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50fc47d5-a9d7-44da-98ae-5e03eb83c3b5', 'attached_at': '', 'detached_at': '', 'volume_id': '231d9978-848b-42d7-b5c3-10a7fe6c4689', 'serial': '231d9978-848b-42d7-b5c3-10a7fe6c4689'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:00:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:00:42 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EknUAxjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:00:42 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:00:42 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:00:42 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b20b50d-cfee-4ecb-a3d2-6a9b883fcd3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:00:42 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a087a6-a39f-42ba-82ec-107e1bd6157c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689] added
Oct 20 12:00:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7757ee1-599d-49d6-9a64-54b6e5ffad39]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0a24ac-5861-4825-871e-f0296360a39a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EknUAxjb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EknUAxjb" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f761043-7e75-440a-a69f-abba55443a5d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EknUAxjb'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff03bf0-4eda-4f81-9141-28061a185b9c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f952792a-4ff9-430f-b845-eb20f4613021]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2683b-ae5f-4ee8-94c3-7c35fe173913]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689, portal: 172.16.0.220,3260]
Oct 20 12:00:42 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689, portal: 172.16.0.220,3260] successful.
Oct 20 12:00:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a8749-4b0d-492c-ace8-5f3130c78e72]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a4fb1f-b999-44ca-89cc-c9f5e3719ebd]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:42 user nova-compute[74241]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)
Oct 20 12:00:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:42 user nova-compute[74241]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)
Oct 20 12:00:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:00:42 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:00:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:43 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[988fb4ad-e383-4c92-8a7d-317454fa72dd]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:43 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EknUAxjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26638303666646466', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638303666646466', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1204858652',display_name='tempest-TestVolumeBootPattern-server-1204858652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1204858652',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-jnojb03e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:00:08Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=50fc47d5-a9d7-44da-98ae-5e03eb83c3b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:b0,bridge_name='br-int',has_traffic_filtering=True,id=799dd78b-9e01-4e17-861b-6a63e890e08d,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799dd78b-9e') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.objects.instance [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'pci_devices' on Instance uuid 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:00:44 user nova-compute[74241]:   <uuid>50fc47d5-a9d7-44da-98ae-5e03eb83c3b5</uuid>
Oct 20 12:00:44 user nova-compute[74241]:   <name>instance-00000027</name>
Oct 20 12:00:44 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:00:44 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:00:44 user nova-compute[74241]:   <metadata>
Oct 20 12:00:44 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:00:44 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:00:44 user nova-compute[74241]:       <nova:name>tempest-TestVolumeBootPattern-server-1204858652</nova:name>
Oct 20 12:00:44 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:00:42</nova:creationTime>
Oct 20 12:00:44 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:00:44 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:00:44 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:00:44 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:00:44 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:00:44 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:00:44 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:00:44 user nova-compute[74241]:       <nova:owner>
Oct 20 12:00:44 user nova-compute[74241]:         <nova:user uuid="bf5346976b7f45e1b146911555f458eb">tempest-TestVolumeBootPattern-71867186-project-member</nova:user>
Oct 20 12:00:44 user nova-compute[74241]:         <nova:project uuid="e6744161987c43408e35c847ec2055a5">tempest-TestVolumeBootPattern-71867186</nova:project>
Oct 20 12:00:44 user nova-compute[74241]:       </nova:owner>
Oct 20 12:00:44 user nova-compute[74241]:       <nova:ports>
Oct 20 12:00:44 user nova-compute[74241]:         <nova:port uuid="799dd78b-9e01-4e17-861b-6a63e890e08d">
Oct 20 12:00:44 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 12:00:44 user nova-compute[74241]:         </nova:port>
Oct 20 12:00:44 user nova-compute[74241]:       </nova:ports>
Oct 20 12:00:44 user nova-compute[74241]:     </nova:instance>
Oct 20 12:00:44 user nova-compute[74241]:   </metadata>
Oct 20 12:00:44 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:00:44 user nova-compute[74241]:     <system>
Oct 20 12:00:44 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:00:44 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:00:44 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:00:44 user nova-compute[74241]:       <entry name="serial">50fc47d5-a9d7-44da-98ae-5e03eb83c3b5</entry>
Oct 20 12:00:44 user nova-compute[74241]:       <entry name="uuid">50fc47d5-a9d7-44da-98ae-5e03eb83c3b5</entry>
Oct 20 12:00:44 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:00:44 user nova-compute[74241]:     </system>
Oct 20 12:00:44 user nova-compute[74241]:   </sysinfo>
Oct 20 12:00:44 user nova-compute[74241]:   <os>
Oct 20 12:00:44 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:00:44 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:00:44 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:00:44 user nova-compute[74241]:   </os>
Oct 20 12:00:44 user nova-compute[74241]:   <features>
Oct 20 12:00:44 user nova-compute[74241]:     <acpi/>
Oct 20 12:00:44 user nova-compute[74241]:     <apic/>
Oct 20 12:00:44 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:00:44 user nova-compute[74241]:   </features>
Oct 20 12:00:44 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:00:44 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:00:44 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:00:44 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:00:44 user nova-compute[74241]:   </clock>
Oct 20 12:00:44 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:00:44 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:00:44 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:00:44 user nova-compute[74241]:   </cpu>
Oct 20 12:00:44 user nova-compute[74241]:   <devices>
Oct 20 12:00:44 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:00:44 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:00:44 user nova-compute[74241]:       <source dev="/dev/sdb"/>
Oct 20 12:00:44 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:00:44 user nova-compute[74241]:       <serial>231d9978-848b-42d7-b5c3-10a7fe6c4689</serial>
Oct 20 12:00:44 user nova-compute[74241]:     </disk>
Oct 20 12:00:44 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:00:44 user nova-compute[74241]:       <mac address="fa:16:3e:2b:23:b0"/>
Oct 20 12:00:44 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:00:44 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:00:44 user nova-compute[74241]:       <target dev="tap799dd78b-9e"/>
Oct 20 12:00:44 user nova-compute[74241]:     </interface>
Oct 20 12:00:44 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:00:44 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/50fc47d5-a9d7-44da-98ae-5e03eb83c3b5/console.log" append="off"/>
Oct 20 12:00:44 user nova-compute[74241]:     </serial>
Oct 20 12:00:44 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:00:44 user nova-compute[74241]:     <video>
Oct 20 12:00:44 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:00:44 user nova-compute[74241]:     </video>
Oct 20 12:00:44 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:00:44 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:00:44 user nova-compute[74241]:     </rng>
Oct 20 12:00:44 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:00:44 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:00:44 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:00:44 user nova-compute[74241]:     </memballoon>
Oct 20 12:00:44 user nova-compute[74241]:   </devices>
Oct 20 12:00:44 user nova-compute[74241]: </domain>
Oct 20 12:00:44 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1204858652',display_name='tempest-TestVolumeBootPattern-server-1204858652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1204858652',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-jnojb03e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:00:08Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=50fc47d5-a9d7-44da-98ae-5e03eb83c3b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:b0,bridge_name='br-int',has_traffic_filtering=True,id=799dd78b-9e01-4e17-861b-6a63e890e08d,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799dd78b-9e') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG os_vif [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:b0,bridge_name='br-int',has_traffic_filtering=True,id=799dd78b-9e01-4e17-861b-6a63e890e08d,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799dd78b-9e') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b884e46-5ce3-5448-9a9b-aa4eed4a2e8e', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap799dd78b-9e, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap799dd78b-9e, col_values=(('qos', UUID('1a3c1319-dad3-4c19-81b3-523c534f8fa6')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap799dd78b-9e, col_values=(('external_ids', {'iface-id': '799dd78b-9e01-4e17-861b-6a63e890e08d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:23:b0', 'vm-uuid': '50fc47d5-a9d7-44da-98ae-5e03eb83c3b5'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:44 user nova-compute[74241]: INFO os_vif [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:b0,bridge_name='br-int',has_traffic_filtering=True,id=799dd78b-9e01-4e17-861b-6a63e890e08d,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799dd78b-9e')
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:00:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No VIF found with MAC fa:16:3e:2b:23:b0, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:00:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-368fff68-42c4-4afd-886c-cd79b6c9500e req-57b9da97-285c-408b-90b5-88d8a7c8f7e5 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received event network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-368fff68-42c4-4afd-886c-cd79b6c9500e req-57b9da97-285c-408b-90b5-88d8a7c8f7e5 service nova] Acquiring lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-368fff68-42c4-4afd-886c-cd79b6c9500e req-57b9da97-285c-408b-90b5-88d8a7c8f7e5 service nova] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-368fff68-42c4-4afd-886c-cd79b6c9500e req-57b9da97-285c-408b-90b5-88d8a7c8f7e5 service nova] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-368fff68-42c4-4afd-886c-cd79b6c9500e req-57b9da97-285c-408b-90b5-88d8a7c8f7e5 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] No waiting events found dispatching network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:45 user nova-compute[74241]: WARNING nova.compute.manager [req-368fff68-42c4-4afd-886c-cd79b6c9500e req-57b9da97-285c-408b-90b5-88d8a7c8f7e5 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received unexpected event network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d for instance with vm_state building and task_state spawning.
Oct 20 12:00:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:00:47 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Instance spawned successfully.
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:47 user nova-compute[74241]: INFO nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Took 5.20 seconds to spawn the instance on the hypervisor.
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:47 user nova-compute[74241]: INFO nova.compute.manager [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Took 40.10 seconds to build instance.
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-8b6e0c5f-ed20-4bb6-ad09-06951cb9a535 req-d1d2cfc8-9fff-4b88-b430-5cad0d22f437 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received event network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8b6e0c5f-ed20-4bb6-ad09-06951cb9a535 req-d1d2cfc8-9fff-4b88-b430-5cad0d22f437 service nova] Acquiring lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8b6e0c5f-ed20-4bb6-ad09-06951cb9a535 req-d1d2cfc8-9fff-4b88-b430-5cad0d22f437 service nova] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8b6e0c5f-ed20-4bb6-ad09-06951cb9a535 req-d1d2cfc8-9fff-4b88-b430-5cad0d22f437 service nova] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-8b6e0c5f-ed20-4bb6-ad09-06951cb9a535 req-d1d2cfc8-9fff-4b88-b430-5cad0d22f437 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] No waiting events found dispatching network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:47 user nova-compute[74241]: WARNING nova.compute.manager [req-8b6e0c5f-ed20-4bb6-ad09-06951cb9a535 req-d1d2cfc8-9fff-4b88-b430-5cad0d22f437 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received unexpected event network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d for instance with vm_state active and task_state None.
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-82be74ab-06c8-41b1-99f4-7a6346f9e84b tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.302s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:00:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Creating image(s)
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Ensure instance console log exists: /opt/stack/data/nova/instances/faa206d7-8728-4df2-be7d-cd0cb9e01bae/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Start _get_guest_xml network_info=[{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '02b3bba1-af44-4d94-b8bd-b57e349f46bf', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPiLNeGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'faa206d7-8728-4df2-be7d-cd0cb9e01bae', 'attached_at': '', 'detached_at': '', 'volume_id': 'd404e218-9f3e-4b3f-a04e-ee52ed206b74', 'serial': 'd404e218-9f3e-4b3f-a04e-ee52ed206b74'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:00:48 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:00:48 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPiLNeGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:00:48 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:00:48 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:00:48 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[21942429-f147-4ee3-a8eb-d51d888cc58d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:00:48 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[47399ace-d715-446c-b3e3-a3363ed71a21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74] added
Oct 20 12:00:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53adf0d-9b2e-4684-ae6c-6ddbcea60025]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dab0a1-8e85-46e4-8f31-9be673938dc5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPiLNeGu {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPiLNeGu" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7276fbef-cd9e-42de-8c2d-29753c393359]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EPiLNeGu'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[80023f0b-2214-49ba-a252-c73ee8fb1ec5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ac7c8-9d9f-4c41-9a2e-420c38828a60]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:48 user nova-compute[74241]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)
Oct 20 12:00:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:48 user nova-compute[74241]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)
Oct 20 12:00:48 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:00:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0763ee27-cc43-4104-ac4e-be460e0d57e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260]
Oct 20 12:00:49 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260] successful.
Oct 20 12:00:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1010cf80-a513-4619-b674-36540dc56e18]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5777b2e6-6393-4e39-951c-44208f2c7473]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:49 user nova-compute[74241]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)
Oct 20 12:00:49 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:00:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:00:49 user nova-compute[74241]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)
Oct 20 12:00:49 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:00:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8db1d3-8b21-4ad0-892a-fce1af4c8359]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPiLNeGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:00:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23739626631666662', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739626631666662', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-994614910',display_name='tempest-TestShelveInstance-server-994614910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-994614910',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBGA8EIm8bdVJEoVP1A+o2QsEnh5s5Fjh3QwSwGdgU1grqVHyJ15uJYdk5fN9/WKU3de/G6oP6K5TbfThBalLdsEvW+DkCwTCM5GBB4EeMKPhzV/HKHJ94FJdzFG2kSA==',key_name='tempest-TestShelveInstance-535819981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5e24daa11c4757afc2c27aa246d31d',ramdisk_id='',reservation_id='r-tfo5a02l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1406034018',owner_user_name='tempest-TestShelveInstance-1406034018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:00:17Z,user_data=None,user_id='c95f4f751dd443059465a9c3daa01f52',uuid=faa206d7-8728-4df2-be7d-cd0cb9e01bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converting VIF {"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.objects.instance [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lazy-loading 'pci_devices' on Instance uuid faa206d7-8728-4df2-be7d-cd0cb9e01bae {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:00:50 user nova-compute[74241]:   <uuid>faa206d7-8728-4df2-be7d-cd0cb9e01bae</uuid>
Oct 20 12:00:50 user nova-compute[74241]:   <name>instance-00000028</name>
Oct 20 12:00:50 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:00:50 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:00:50 user nova-compute[74241]:   <metadata>
Oct 20 12:00:50 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:00:50 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:00:50 user nova-compute[74241]:       <nova:name>tempest-TestShelveInstance-server-994614910</nova:name>
Oct 20 12:00:50 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:00:48</nova:creationTime>
Oct 20 12:00:50 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:00:50 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:00:50 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:00:50 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:00:50 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:00:50 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:00:50 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:00:50 user nova-compute[74241]:       <nova:owner>
Oct 20 12:00:50 user nova-compute[74241]:         <nova:user uuid="c95f4f751dd443059465a9c3daa01f52">tempest-TestShelveInstance-1406034018-project-member</nova:user>
Oct 20 12:00:50 user nova-compute[74241]:         <nova:project uuid="9d5e24daa11c4757afc2c27aa246d31d">tempest-TestShelveInstance-1406034018</nova:project>
Oct 20 12:00:50 user nova-compute[74241]:       </nova:owner>
Oct 20 12:00:50 user nova-compute[74241]:       <nova:ports>
Oct 20 12:00:50 user nova-compute[74241]:         <nova:port uuid="a53098e1-97f5-4c14-aeb6-7883ab442ca2">
Oct 20 12:00:50 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 12:00:50 user nova-compute[74241]:         </nova:port>
Oct 20 12:00:50 user nova-compute[74241]:       </nova:ports>
Oct 20 12:00:50 user nova-compute[74241]:     </nova:instance>
Oct 20 12:00:50 user nova-compute[74241]:   </metadata>
Oct 20 12:00:50 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:00:50 user nova-compute[74241]:     <system>
Oct 20 12:00:50 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:00:50 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:00:50 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:00:50 user nova-compute[74241]:       <entry name="serial">faa206d7-8728-4df2-be7d-cd0cb9e01bae</entry>
Oct 20 12:00:50 user nova-compute[74241]:       <entry name="uuid">faa206d7-8728-4df2-be7d-cd0cb9e01bae</entry>
Oct 20 12:00:50 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:00:50 user nova-compute[74241]:     </system>
Oct 20 12:00:50 user nova-compute[74241]:   </sysinfo>
Oct 20 12:00:50 user nova-compute[74241]:   <os>
Oct 20 12:00:50 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:00:50 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:00:50 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:00:50 user nova-compute[74241]:   </os>
Oct 20 12:00:50 user nova-compute[74241]:   <features>
Oct 20 12:00:50 user nova-compute[74241]:     <acpi/>
Oct 20 12:00:50 user nova-compute[74241]:     <apic/>
Oct 20 12:00:50 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:00:50 user nova-compute[74241]:   </features>
Oct 20 12:00:50 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:00:50 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:00:50 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:00:50 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:00:50 user nova-compute[74241]:   </clock>
Oct 20 12:00:50 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:00:50 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:00:50 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:00:50 user nova-compute[74241]:   </cpu>
Oct 20 12:00:50 user nova-compute[74241]:   <devices>
Oct 20 12:00:50 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:00:50 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:00:50 user nova-compute[74241]:       <source dev="/dev/sdc"/>
Oct 20 12:00:50 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:00:50 user nova-compute[74241]:       <serial>d404e218-9f3e-4b3f-a04e-ee52ed206b74</serial>
Oct 20 12:00:50 user nova-compute[74241]:     </disk>
Oct 20 12:00:50 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:00:50 user nova-compute[74241]:       <mac address="fa:16:3e:56:10:b1"/>
Oct 20 12:00:50 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:00:50 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:00:50 user nova-compute[74241]:       <target dev="tapa53098e1-97"/>
Oct 20 12:00:50 user nova-compute[74241]:     </interface>
Oct 20 12:00:50 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:00:50 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/faa206d7-8728-4df2-be7d-cd0cb9e01bae/console.log" append="off"/>
Oct 20 12:00:50 user nova-compute[74241]:     </serial>
Oct 20 12:00:50 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:00:50 user nova-compute[74241]:     <video>
Oct 20 12:00:50 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:00:50 user nova-compute[74241]:     </video>
Oct 20 12:00:50 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:00:50 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:00:50 user nova-compute[74241]:     </rng>
Oct 20 12:00:50 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:00:50 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:00:50 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:00:50 user nova-compute[74241]:     </memballoon>
Oct 20 12:00:50 user nova-compute[74241]:   </devices>
Oct 20 12:00:50 user nova-compute[74241]: </domain>
Oct 20 12:00:50 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-994614910',display_name='tempest-TestShelveInstance-server-994614910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-994614910',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBGA8EIm8bdVJEoVP1A+o2QsEnh5s5Fjh3QwSwGdgU1grqVHyJ15uJYdk5fN9/WKU3de/G6oP6K5TbfThBalLdsEvW+DkCwTCM5GBB4EeMKPhzV/HKHJ94FJdzFG2kSA==',key_name='tempest-TestShelveInstance-535819981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d5e24daa11c4757afc2c27aa246d31d',ramdisk_id='',reservation_id='r-tfo5a02l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1406034018',owner_user_name='tempest-TestShelveInstance-1406034018-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:00:17Z,user_data=None,user_id='c95f4f751dd443059465a9c3daa01f52',uuid=faa206d7-8728-4df2-be7d-cd0cb9e01bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converting VIF {"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG os_vif [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccb6c560-b8a0-56b2-bd47-4e0038b6c086', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa53098e1-97, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa53098e1-97, col_values=(('qos', UUID('3dd1b300-acde-4722-8a21-8096395f756d')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa53098e1-97, col_values=(('external_ids', {'iface-id': 'a53098e1-97f5-4c14-aeb6-7883ab442ca2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:10:b1', 'vm-uuid': 'faa206d7-8728-4df2-be7d-cd0cb9e01bae'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:50 user nova-compute[74241]: INFO os_vif [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97')
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:00:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] No VIF found with MAC fa:16:3e:56:10:b1, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:00:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-d4b5c062-1559-40b5-8722-ae6d7d3f7c6d req-13a0e7ee-e9ea-478e-9dc6-49b025648b73 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d4b5c062-1559-40b5-8722-ae6d7d3f7c6d req-13a0e7ee-e9ea-478e-9dc6-49b025648b73 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d4b5c062-1559-40b5-8722-ae6d7d3f7c6d req-13a0e7ee-e9ea-478e-9dc6-49b025648b73 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d4b5c062-1559-40b5-8722-ae6d7d3f7c6d req-13a0e7ee-e9ea-478e-9dc6-49b025648b73 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-d4b5c062-1559-40b5-8722-ae6d7d3f7c6d req-13a0e7ee-e9ea-478e-9dc6-49b025648b73 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:51 user nova-compute[74241]: WARNING nova.compute.manager [req-d4b5c062-1559-40b5-8722-ae6d7d3f7c6d req-13a0e7ee-e9ea-478e-9dc6-49b025648b73 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state building and task_state spawning.
Oct 20 12:00:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:00:53 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance spawned successfully.
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:00:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c69286b-1c64-4a9d-847f-9f9b89ebee0c req-4048ada0-66f4-4cf6-bfe9-758f3c488fd8 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:00:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c69286b-1c64-4a9d-847f-9f9b89ebee0c req-4048ada0-66f4-4cf6-bfe9-758f3c488fd8 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:00:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c69286b-1c64-4a9d-847f-9f9b89ebee0c req-4048ada0-66f4-4cf6-bfe9-758f3c488fd8 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:00:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3c69286b-1c64-4a9d-847f-9f9b89ebee0c req-4048ada0-66f4-4cf6-bfe9-758f3c488fd8 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-3c69286b-1c64-4a9d-847f-9f9b89ebee0c req-4048ada0-66f4-4cf6-bfe9-758f3c488fd8 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:00:54 user nova-compute[74241]: WARNING nova.compute.manager [req-3c69286b-1c64-4a9d-847f-9f9b89ebee0c req-4048ada0-66f4-4cf6-bfe9-758f3c488fd8 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state building and task_state spawning.
Oct 20 12:00:54 user nova-compute[74241]: INFO nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 20 12:00:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:00:54 user nova-compute[74241]: INFO nova.compute.manager [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Took 37.28 seconds to build instance.
Oct 20 12:00:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-60d13930-4f29-4a3d-afa4-b6b206daa19d tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.430s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:00:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:00:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:03 user nova-compute[74241]: INFO nova.compute.manager [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Terminating instance
Oct 20 12:01:03 user nova-compute[74241]: DEBUG nova.compute.manager [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-3b77c986-50ee-41b0-9048-2c2fff8fb37b req-1bf981a8-87db-4e67-9369-f0fbfe3bf502 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-unplugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3b77c986-50ee-41b0-9048-2c2fff8fb37b req-1bf981a8-87db-4e67-9369-f0fbfe3bf502 service nova] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3b77c986-50ee-41b0-9048-2c2fff8fb37b req-1bf981a8-87db-4e67-9369-f0fbfe3bf502 service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3b77c986-50ee-41b0-9048-2c2fff8fb37b req-1bf981a8-87db-4e67-9369-f0fbfe3bf502 service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-3b77c986-50ee-41b0-9048-2c2fff8fb37b req-1bf981a8-87db-4e67-9369-f0fbfe3bf502 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] No waiting events found dispatching network-vif-unplugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:01:03 user nova-compute[74241]: DEBUG nova.compute.manager [req-3b77c986-50ee-41b0-9048-2c2fff8fb37b req-1bf981a8-87db-4e67-9369-f0fbfe3bf502 service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-unplugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:01:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Instance destroyed successfully.
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.objects.instance [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lazy-loading 'resources' on Instance uuid edc8a08d-60ed-46a0-a381-9c5b4af93d89 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-650995071',display_name='tempest-TestMinimumBasicScenario-server-650995071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-650995071',id=36,image_ref='f4eb7f92-82e1-4927-9b74-f0f6b8dc0206',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLOipju7bJBwHFlpsL9QrOYGVtYfEtjtaB+hBJdq5pmHzGmBAFES+q5wTzNJhcvBNQWQed2mC4P+6VTTygJpkl7NdmJOL4XewUesgMpc/vko+KkZk+mgQBy5EuRUrzHZg==',key_name='tempest-TestMinimumBasicScenario-1224332270',keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:55:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='137870b8216f4a49b1eecde3ec14b75a',ramdisk_id='',reservation_id='r-9naea2e8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4eb7f92-82e1-4927-9b74-f0f6b8dc0206',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2068641795',owner_user_name='tempest-TestMinimumBasicScenario-2068641795-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:58:16Z,user_data=None,user_id='cd2b2cd84c5a403f868d69ccc7f8afc4',uuid=edc8a08d-60ed-46a0-a381-9c5b4af93d89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converting VIF {"id": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "address": "fa:16:3e:5a:6e:92", "network": {"id": "b9694885-6cc9-4cda-8cb8-376ef920342c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1324017330-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "137870b8216f4a49b1eecde3ec14b75a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b385ffd-f8", "ovs_interfaceid": "2b385ffd-f8e8-472c-a32a-7ee2965b4932", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:6e:92,bridge_name='br-int',has_traffic_filtering=True,id=2b385ffd-f8e8-472c-a32a-7ee2965b4932,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b385ffd-f8') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG os_vif [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:6e:92,bridge_name='br-int',has_traffic_filtering=True,id=2b385ffd-f8e8-472c-a32a-7ee2965b4932,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b385ffd-f8') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b385ffd-f8, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d8f7f17-58c2-472e-ab81-c27a959d5321) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:04 user nova-compute[74241]: INFO os_vif [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:6e:92,bridge_name='br-int',has_traffic_filtering=True,id=2b385ffd-f8e8-472c-a32a-7ee2965b4932,network=Network(b9694885-6cc9-4cda-8cb8-376ef920342c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b385ffd-f8')
Oct 20 12:01:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Deleting instance files /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89_del
Oct 20 12:01:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Deletion of /opt/stack/data/nova/instances/edc8a08d-60ed-46a0-a381-9c5b4af93d89_del complete
Oct 20 12:01:04 user nova-compute[74241]: INFO nova.compute.manager [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 20 12:01:04 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-62235eff-d158-45a1-8a7c-18948b008f77 req-706f40e7-843c-4ab0-856e-bb0a1bf5636f service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-deleted-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:01:04 user nova-compute[74241]: INFO nova.compute.manager [req-62235eff-d158-45a1-8a7c-18948b008f77 req-706f40e7-843c-4ab0-856e-bb0a1bf5636f service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Neutron deleted interface 2b385ffd-f8e8-472c-a32a-7ee2965b4932; detaching it from the instance and deleting it from the info cache
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.network.neutron [req-62235eff-d158-45a1-8a7c-18948b008f77 req-706f40e7-843c-4ab0-856e-bb0a1bf5636f service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:01:04 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Took 0.49 seconds to deallocate network for instance.
Oct 20 12:01:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-62235eff-d158-45a1-8a7c-18948b008f77 req-706f40e7-843c-4ab0-856e-bb0a1bf5636f service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Detach interface failed, port_id=2b385ffd-f8e8-472c-a32a-7ee2965b4932, reason: Instance edc8a08d-60ed-46a0-a381-9c5b4af93d89 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:05 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:01:05 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:01:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:05 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Deleted allocations for instance edc8a08d-60ed-46a0-a381-9c5b4af93d89
Oct 20 12:01:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b97fb94d-6b8f-43af-b8e5-be74797d7806 tempest-TestMinimumBasicScenario-2068641795 tempest-TestMinimumBasicScenario-2068641795-project-member] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.019s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-0a2d5ced-2cc7-46a6-bb90-a1876469f34e req-d82784d9-740f-4c24-8bc4-88b15d09788c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0a2d5ced-2cc7-46a6-bb90-a1876469f34e req-d82784d9-740f-4c24-8bc4-88b15d09788c service nova] Acquiring lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0a2d5ced-2cc7-46a6-bb90-a1876469f34e req-d82784d9-740f-4c24-8bc4-88b15d09788c service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0a2d5ced-2cc7-46a6-bb90-a1876469f34e req-d82784d9-740f-4c24-8bc4-88b15d09788c service nova] Lock "edc8a08d-60ed-46a0-a381-9c5b4af93d89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-0a2d5ced-2cc7-46a6-bb90-a1876469f34e req-d82784d9-740f-4c24-8bc4-88b15d09788c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] No waiting events found dispatching network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:01:06 user nova-compute[74241]: WARNING nova.compute.manager [req-0a2d5ced-2cc7-46a6-bb90-a1876469f34e req-d82784d9-740f-4c24-8bc4-88b15d09788c service nova] [instance: edc8a08d-60ed-46a0-a381-9c5b4af93d89] Received unexpected event network-vif-plugged-2b385ffd-f8e8-472c-a32a-7ee2965b4932 for instance with vm_state deleted and task_state None.
Oct 20 12:01:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:01:06 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:01:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8045MB free_disk=25.133995056152344GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance faa206d7-8728-4df2-be7d-cd0cb9e01bae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:01:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:01:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:01:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 12:01:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "595814c8-bb69-474f-8d20-c765d6f03eab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:01:16 user nova-compute[74241]: INFO nova.compute.claims [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Claim successful on node user
Oct 20 12:01:16 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:01:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:01:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:01:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:01:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:01:17 user nova-compute[74241]: DEBUG nova.policy [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c611c28a9264820a26f203045040420', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52f8151a0cf44b2d89838da474c2dc68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:01:17 user nova-compute[74241]: INFO nova.virt.block_device [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Booting with volume-backed-image f9a80c7e-66e2-4915-96f8-63e828cf6c2e at /dev/vda
Oct 20 12:01:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Successfully created port: 9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Successfully updated port: 9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquired lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-466ee6b5-3b26-4693-a43e-db4b485a2895 req-9e7fc7d4-4667-4fb2-82b3-392cc0c281bb service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-changed-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-466ee6b5-3b26-4693-a43e-db4b485a2895 req-9e7fc7d4-4667-4fb2-82b3-392cc0c281bb service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Refreshing instance network info cache due to event network-changed-9eaf149b-3d41-4c5f-ae86-015b6b0202cd. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-466ee6b5-3b26-4693-a43e-db4b485a2895 req-9e7fc7d4-4667-4fb2-82b3-392cc0c281bb service nova] Acquiring lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:01:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:01:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updating instance_info_cache with network_info: [{"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:01:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Releasing lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:01:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance network_info: |[{"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:01:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-466ee6b5-3b26-4693-a43e-db4b485a2895 req-9e7fc7d4-4667-4fb2-82b3-392cc0c281bb service nova] Acquired lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:01:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-466ee6b5-3b26-4693-a43e-db4b485a2895 req-9e7fc7d4-4667-4fb2-82b3-392cc0c281bb service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Refreshing network info cache for port 9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:01:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-466ee6b5-3b26-4693-a43e-db4b485a2895 req-9e7fc7d4-4667-4fb2-82b3-392cc0c281bb service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updated VIF entry in instance network info cache for port 9eaf149b-3d41-4c5f-ae86-015b6b0202cd. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:01:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-466ee6b5-3b26-4693-a43e-db4b485a2895 req-9e7fc7d4-4667-4fb2-82b3-392cc0c281bb service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updating instance_info_cache with network_info: [{"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:01:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-466ee6b5-3b26-4693-a43e-db4b485a2895 req-9e7fc7d4-4667-4fb2-82b3-392cc0c281bb service nova] Releasing lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:01:21 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:01:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:01:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:01:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:01:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:01:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG os_brick.utils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89f3ec5-91ba-4d82-b9e4-a1d98fb324f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5de7a3-e645-46c1-83d7-2bc5c48d5a2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dce83ae-513e-435c-958a-e4b07b7a0e64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[37dfbb8f-c988-46a0-b9af-51a566237123]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:01:48 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:01:48 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[436c8b7e-59dc-4f42-bad8-300d3cba3664]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG os_brick.utils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:01:48 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updating existing volume attachment record: d9cbe3ee-f488-45eb-be7d-d60c5cad6b3b {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:01:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:01:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:58 user nova-compute[74241]: INFO nova.compute.manager [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Terminating instance
Oct 20 12:01:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-880fd04f-b354-4e21-bc20-d1b079cfed79 req-c1d0f96e-5954-4be0-a3d2-8f5c58549f3b service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received event network-vif-unplugged-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-880fd04f-b354-4e21-bc20-d1b079cfed79 req-c1d0f96e-5954-4be0-a3d2-8f5c58549f3b service nova] Acquiring lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-880fd04f-b354-4e21-bc20-d1b079cfed79 req-c1d0f96e-5954-4be0-a3d2-8f5c58549f3b service nova] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-880fd04f-b354-4e21-bc20-d1b079cfed79 req-c1d0f96e-5954-4be0-a3d2-8f5c58549f3b service nova] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-880fd04f-b354-4e21-bc20-d1b079cfed79 req-c1d0f96e-5954-4be0-a3d2-8f5c58549f3b service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] No waiting events found dispatching network-vif-unplugged-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:01:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-880fd04f-b354-4e21-bc20-d1b079cfed79 req-c1d0f96e-5954-4be0-a3d2-8f5c58549f3b service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received event network-vif-unplugged-799dd78b-9e01-4e17-861b-6a63e890e08d for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:59 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Instance destroyed successfully.
Oct 20 12:01:59 user nova-compute[74241]: DEBUG nova.objects.instance [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'resources' on Instance uuid 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1204858652',display_name='tempest-TestVolumeBootPattern-server-1204858652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1204858652',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:00:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-jnojb03e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:00:48Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=50fc47d5-a9d7-44da-98ae-5e03eb83c3b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "799dd78b-9e01-4e17-861b-6a63e890e08d", "address": "fa:16:3e:2b:23:b0", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap799dd78b-9e", "ovs_interfaceid": "799dd78b-9e01-4e17-861b-6a63e890e08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:b0,bridge_name='br-int',has_traffic_filtering=True,id=799dd78b-9e01-4e17-861b-6a63e890e08d,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799dd78b-9e') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_vif [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:b0,bridge_name='br-int',has_traffic_filtering=True,id=799dd78b-9e01-4e17-861b-6a63e890e08d,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799dd78b-9e') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap799dd78b-9e, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a3c1319-dad3-4c19-81b3-523c534f8fa6) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:01:59 user nova-compute[74241]: INFO os_vif [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:23:b0,bridge_name='br-int',has_traffic_filtering=True,id=799dd78b-9e01-4e17-861b-6a63e890e08d,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap799dd78b-9e')
Oct 20 12:01:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EknUAxjb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:01:59 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dab628-609e-4c39-bc24-52eee09b76d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:01:59 user nova-compute[74241]: No targets found.
Oct 20 12:01:59 user nova-compute[74241]: iSNS:
Oct 20 12:01:59 user nova-compute[74241]: No targets found.
Oct 20 12:01:59 user nova-compute[74241]: STATIC:
Oct 20 12:01:59 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74
Oct 20 12:01:59 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:01:59 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:01:59 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:01:59 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:01:59 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:01:59 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689
Oct 20 12:01:59 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:01:59 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:01:59 user nova-compute[74241]: FIRMWARE:
Oct 20 12:01:59 user nova-compute[74241]: No targets found.
Oct 20 12:01:59 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:01:59 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:01:59 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29e6ecf-9549-4e82-8600-eb8a8a890a1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b53a2e-c389-4577-90ce-9273f346b133]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:01:59 user nova-compute[74241]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)
Oct 20 12:01:59 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:01:59 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:01:59 user nova-compute[74241]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 (non-flash)
Oct 20 12:01:59 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:01:59 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5208545f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[639a7892-3c8c-4ad7-8be1-2968d366ee48]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[123256eb-a6bc-48fb-bc42-dacb47c09fa3]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5839cb97-522d-4917-87c8-88198b9fbd0f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[233f8242-eae4-4cc3-8e52-4c67d4f77f5e]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac76071-92b0-4b83-843e-f08d1f2a6835]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c8e149-d065-4ffc-a8cf-d344ed6228ff]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689, portal: 172.16.0.220,3260]
Oct 20 12:01:59 user nova-compute[74241]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689, portal: 172.16.0.220,3260] successful.
Oct 20 12:01:59 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:231d9978-848b-42d7-b5c3-10a7fe6c4689 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b3bec-1af8-4bb0-b342-46bc2d775444]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== disconnect_volume: return (343ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:01:59 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Deleting instance files /opt/stack/data/nova/instances/50fc47d5-a9d7-44da-98ae-5e03eb83c3b5_del
Oct 20 12:01:59 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Deletion of /opt/stack/data/nova/instances/50fc47d5-a9d7-44da-98ae-5e03eb83c3b5_del complete
Oct 20 12:01:59 user nova-compute[74241]: INFO nova.compute.manager [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Took 1.37 seconds to destroy the instance on the hypervisor.
Oct 20 12:01:59 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:01:59 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:02:00 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:02:00 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Took 0.59 seconds to deallocate network for instance.
Oct 20 12:02:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-ad2385e0-3025-4cf4-83be-3cff0b9c5929 req-3f7b0008-52b5-4313-bff7-c4b26258ae1f service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received event network-vif-deleted-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:00 user nova-compute[74241]: INFO nova.compute.manager [req-ad2385e0-3025-4cf4-83be-3cff0b9c5929 req-3f7b0008-52b5-4313-bff7-c4b26258ae1f service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Neutron deleted interface 799dd78b-9e01-4e17-861b-6a63e890e08d; detaching it from the instance and deleting it from the info cache
Oct 20 12:02:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-ad2385e0-3025-4cf4-83be-3cff0b9c5929 req-3f7b0008-52b5-4313-bff7-c4b26258ae1f service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:02:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-ad2385e0-3025-4cf4-83be-3cff0b9c5929 req-3f7b0008-52b5-4313-bff7-c4b26258ae1f service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Detach interface failed, port_id=799dd78b-9e01-4e17-861b-6a63e890e08d, reason: Instance 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:02:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-0433ac3a-56da-4ab2-a595-75c750cb2cd9 req-61972e61-8420-4460-8ab2-0080a3925af0 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received event network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0433ac3a-56da-4ab2-a595-75c750cb2cd9 req-61972e61-8420-4460-8ab2-0080a3925af0 service nova] Acquiring lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0433ac3a-56da-4ab2-a595-75c750cb2cd9 req-61972e61-8420-4460-8ab2-0080a3925af0 service nova] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-0433ac3a-56da-4ab2-a595-75c750cb2cd9 req-61972e61-8420-4460-8ab2-0080a3925af0 service nova] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-0433ac3a-56da-4ab2-a595-75c750cb2cd9 req-61972e61-8420-4460-8ab2-0080a3925af0 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] No waiting events found dispatching network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:02:01 user nova-compute[74241]: WARNING nova.compute.manager [req-0433ac3a-56da-4ab2-a595-75c750cb2cd9 req-61972e61-8420-4460-8ab2-0080a3925af0 service nova] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Received unexpected event network-vif-plugged-799dd78b-9e01-4e17-861b-6a63e890e08d for instance with vm_state active and task_state deleting.
Oct 20 12:02:01 user nova-compute[74241]: INFO nova.compute.manager [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Took 0.96 seconds to detach 1 volumes for instance.
Oct 20 12:02:01 user nova-compute[74241]: DEBUG nova.compute.manager [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5] Deleting volume: 231d9978-848b-42d7-b5c3-10a7fe6c4689 {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:02:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:02 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Deleted allocations for instance 50fc47d5-a9d7-44da-98ae-5e03eb83c3b5
Oct 20 12:02:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-813869e9-cb46-49cb-a7e2-8ac495c7467e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "50fc47d5-a9d7-44da-98ae-5e03eb83c3b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.608s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:03 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:02:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Creating image(s)
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Ensure instance console log exists: /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Start _get_guest_xml network_info=[{"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'd9cbe3ee-f488-45eb-be7d-d60c5cad6b3b', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPrnWgUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '595814c8-bb69-474f-8d20-c765d6f03eab', 'attached_at': '', 'detached_at': '', 'volume_id': '312aed4d-80f1-4986-b638-086851269efb', 'serial': '312aed4d-80f1-4986-b638-086851269efb'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:02:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:02:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPrnWgUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:02:08 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:02:08 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:02:08 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d258de19-a88b-4395-bc3c-6b5a367f3f5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:02:08 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[88650ffa-2c55-47f2-a8f4-cd45bcd1bd96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb] added
Oct 20 12:02:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ab52a8-db40-422a-82c9-d55382464128]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebba57a7-3270-4ded-bb35-27541577de9f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPrnWgUm {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPrnWgUm" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a231f0a-7f8a-4558-96a6-383fd204cb3c]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EPrnWgUm'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b2327-acb2-4761-abc5-b2de9f3e4d50]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd92c958-e4f1-4887-8c1c-1aa9b6bb9ac9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[515ede6a-20fc-4cac-a03b-ca2e2e53f035]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb, portal: 172.16.0.220,3260]
Oct 20 12:02:08 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb, portal: 172.16.0.220,3260] successful.
Oct 20 12:02:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[44901f4c-262d-4320-af33-dd9bac4873a1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b70fa-e265-44d1-b8ae-84378c84ba26]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:02:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:08 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:02:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a8fc85-1895-46c8-bd39-73caff4e2352]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPrnWgUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-8343c57d-b390-4f80-aead-fa33b303e410 req-395d2548-e742-4fe6-acb2-67438ba26811 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-8343c57d-b390-4f80-aead-fa33b303e410 req-395d2548-e742-4fe6-acb2-67438ba26811 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing instance network info cache due to event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8343c57d-b390-4f80-aead-fa33b303e410 req-395d2548-e742-4fe6-acb2-67438ba26811 service nova] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8343c57d-b390-4f80-aead-fa33b303e410 req-395d2548-e742-4fe6-acb2-67438ba26811 service nova] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:02:08 user nova-compute[74241]: DEBUG nova.network.neutron [req-8343c57d-b390-4f80-aead-fa33b303e410 req-395d2548-e742-4fe6-acb2-67438ba26811 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-8343c57d-b390-4f80-aead-fa33b303e410 req-395d2548-e742-4fe6-acb2-67438ba26811 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updated VIF entry in instance network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-8343c57d-b390-4f80-aead-fa33b303e410 req-395d2548-e742-4fe6-acb2-67438ba26811 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8343c57d-b390-4f80-aead-fa33b303e410 req-395d2548-e742-4fe6-acb2-67438ba26811 service nova] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23231313762333663', 'path': '/dev/sde'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231313762333663', 'path': '/dev/sde'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2111188889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2111188889',id=42,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-1qfjrz5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:01:17Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=595814c8-bb69-474f-8d20-c765d6f03eab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:16:68,bridge_name='br-int',has_traffic_filtering=True,id=9eaf149b-3d41-4c5f-ae86-015b6b0202cd,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eaf149b-3d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'pci_devices' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:09 user nova-compute[74241]: INFO nova.compute.manager [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Shelve offloading
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:02:09 user nova-compute[74241]:   <uuid>595814c8-bb69-474f-8d20-c765d6f03eab</uuid>
Oct 20 12:02:09 user nova-compute[74241]:   <name>instance-0000002a</name>
Oct 20 12:02:09 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:02:09 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:02:09 user nova-compute[74241]:   <metadata>
Oct 20 12:02:09 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:02:09 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:02:09 user nova-compute[74241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2111188889</nova:name>
Oct 20 12:02:09 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:02:08</nova:creationTime>
Oct 20 12:02:09 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:02:09 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:02:09 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:02:09 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:02:09 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:02:09 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:02:09 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:02:09 user nova-compute[74241]:       <nova:owner>
Oct 20 12:02:09 user nova-compute[74241]:         <nova:user uuid="0c611c28a9264820a26f203045040420">tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member</nova:user>
Oct 20 12:02:09 user nova-compute[74241]:         <nova:project uuid="52f8151a0cf44b2d89838da474c2dc68">tempest-ServerBootFromVolumeStableRescueTest-929360393</nova:project>
Oct 20 12:02:09 user nova-compute[74241]:       </nova:owner>
Oct 20 12:02:09 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 12:02:09 user nova-compute[74241]:       <nova:ports>
Oct 20 12:02:09 user nova-compute[74241]:         <nova:port uuid="9eaf149b-3d41-4c5f-ae86-015b6b0202cd">
Oct 20 12:02:09 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 12:02:09 user nova-compute[74241]:         </nova:port>
Oct 20 12:02:09 user nova-compute[74241]:       </nova:ports>
Oct 20 12:02:09 user nova-compute[74241]:     </nova:instance>
Oct 20 12:02:09 user nova-compute[74241]:   </metadata>
Oct 20 12:02:09 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:02:09 user nova-compute[74241]:     <system>
Oct 20 12:02:09 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:02:09 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:02:09 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:02:09 user nova-compute[74241]:       <entry name="serial">595814c8-bb69-474f-8d20-c765d6f03eab</entry>
Oct 20 12:02:09 user nova-compute[74241]:       <entry name="uuid">595814c8-bb69-474f-8d20-c765d6f03eab</entry>
Oct 20 12:02:09 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:02:09 user nova-compute[74241]:     </system>
Oct 20 12:02:09 user nova-compute[74241]:   </sysinfo>
Oct 20 12:02:09 user nova-compute[74241]:   <os>
Oct 20 12:02:09 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:02:09 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:02:09 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:02:09 user nova-compute[74241]:   </os>
Oct 20 12:02:09 user nova-compute[74241]:   <features>
Oct 20 12:02:09 user nova-compute[74241]:     <acpi/>
Oct 20 12:02:09 user nova-compute[74241]:     <apic/>
Oct 20 12:02:09 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:02:09 user nova-compute[74241]:   </features>
Oct 20 12:02:09 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:02:09 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:02:09 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:02:09 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:02:09 user nova-compute[74241]:   </clock>
Oct 20 12:02:09 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:02:09 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:02:09 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:02:09 user nova-compute[74241]:   </cpu>
Oct 20 12:02:09 user nova-compute[74241]:   <devices>
Oct 20 12:02:09 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:02:09 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:02:09 user nova-compute[74241]:       <source dev="/dev/sde"/>
Oct 20 12:02:09 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:02:09 user nova-compute[74241]:       <serial>312aed4d-80f1-4986-b638-086851269efb</serial>
Oct 20 12:02:09 user nova-compute[74241]:     </disk>
Oct 20 12:02:09 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:02:09 user nova-compute[74241]:       <mac address="fa:16:3e:95:16:68"/>
Oct 20 12:02:09 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:02:09 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:02:09 user nova-compute[74241]:       <target dev="tap9eaf149b-3d"/>
Oct 20 12:02:09 user nova-compute[74241]:     </interface>
Oct 20 12:02:09 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:02:09 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/console.log" append="off"/>
Oct 20 12:02:09 user nova-compute[74241]:     </serial>
Oct 20 12:02:09 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:02:09 user nova-compute[74241]:     <video>
Oct 20 12:02:09 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:02:09 user nova-compute[74241]:     </video>
Oct 20 12:02:09 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:02:09 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:02:09 user nova-compute[74241]:     </rng>
Oct 20 12:02:09 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:02:09 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:02:09 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:02:09 user nova-compute[74241]:     </memballoon>
Oct 20 12:02:09 user nova-compute[74241]:   </devices>
Oct 20 12:02:09 user nova-compute[74241]: </domain>
Oct 20 12:02:09 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2111188889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2111188889',id=42,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-1qfjrz5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:01:17Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=595814c8-bb69-474f-8d20-c765d6f03eab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:16:68,bridge_name='br-int',has_traffic_filtering=True,id=9eaf149b-3d41-4c5f-ae86-015b6b0202cd,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eaf149b-3d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG os_vif [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:16:68,bridge_name='br-int',has_traffic_filtering=True,id=9eaf149b-3d41-4c5f-ae86-015b6b0202cd,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eaf149b-3d') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb0ef61f-5323-58b8-8bc0-f31ecb337857', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9eaf149b-3d, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9eaf149b-3d, col_values=(('qos', UUID('690508c8-3b70-4b71-b1b6-f2ecb68a9520')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9eaf149b-3d, col_values=(('external_ids', {'iface-id': '9eaf149b-3d41-4c5f-ae86-015b6b0202cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:16:68', 'vm-uuid': '595814c8-bb69-474f-8d20-c765d6f03eab'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: INFO os_vif [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:16:68,bridge_name='br-int',has_traffic_filtering=True,id=9eaf149b-3d41-4c5f-ae86-015b6b0202cd,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eaf149b-3d')
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No VIF found with MAC fa:16:3e:95:16:68, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-a4c5bdf8-d267-434e-a9c1-94caad6ab65f req-35a25a4c-6189-471c-bf95-f75e75413cbe service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a4c5bdf8-d267-434e-a9c1-94caad6ab65f req-35a25a4c-6189-471c-bf95-f75e75413cbe service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a4c5bdf8-d267-434e-a9c1-94caad6ab65f req-35a25a4c-6189-471c-bf95-f75e75413cbe service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a4c5bdf8-d267-434e-a9c1-94caad6ab65f req-35a25a4c-6189-471c-bf95-f75e75413cbe service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-a4c5bdf8-d267-434e-a9c1-94caad6ab65f req-35a25a4c-6189-471c-bf95-f75e75413cbe service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:02:10 user nova-compute[74241]: WARNING nova.compute.manager [req-a4c5bdf8-d267-434e-a9c1-94caad6ab65f req-35a25a4c-6189-471c-bf95-f75e75413cbe service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state active and task_state shelving.
Oct 20 12:02:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-626c7ace-f253-4ab0-ae66-33e2c564e9ab req-9cf7222e-d1ed-4cb3-8a54-0eaf21264a84 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-626c7ace-f253-4ab0-ae66-33e2c564e9ab req-9cf7222e-d1ed-4cb3-8a54-0eaf21264a84 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-626c7ace-f253-4ab0-ae66-33e2c564e9ab req-9cf7222e-d1ed-4cb3-8a54-0eaf21264a84 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-626c7ace-f253-4ab0-ae66-33e2c564e9ab req-9cf7222e-d1ed-4cb3-8a54-0eaf21264a84 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-626c7ace-f253-4ab0-ae66-33e2c564e9ab req-9cf7222e-d1ed-4cb3-8a54-0eaf21264a84 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:02:14 user nova-compute[74241]: WARNING nova.compute.manager [req-626c7ace-f253-4ab0-ae66-33e2c564e9ab req-9cf7222e-d1ed-4cb3-8a54-0eaf21264a84 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state building and task_state spawning.
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-830f2ba2-6447-429f-9b64-b79a91b103b6 req-5becb7d8-86bd-40a0-855f-f924ec470e09 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-830f2ba2-6447-429f-9b64-b79a91b103b6 req-5becb7d8-86bd-40a0-855f-f924ec470e09 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-830f2ba2-6447-429f-9b64-b79a91b103b6 req-5becb7d8-86bd-40a0-855f-f924ec470e09 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-830f2ba2-6447-429f-9b64-b79a91b103b6 req-5becb7d8-86bd-40a0-855f-f924ec470e09 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-830f2ba2-6447-429f-9b64-b79a91b103b6 req-5becb7d8-86bd-40a0-855f-f924ec470e09 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:02:14 user nova-compute[74241]: WARNING nova.compute.manager [req-830f2ba2-6447-429f-9b64-b79a91b103b6 req-5becb7d8-86bd-40a0-855f-f924ec470e09 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state active and task_state shelving.
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-50d1f98f-c607-415d-954c-892b4c5d0ae4 req-fab7b05d-083f-4ec6-acd8-76f684095b78 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-50d1f98f-c607-415d-954c-892b4c5d0ae4 req-fab7b05d-083f-4ec6-acd8-76f684095b78 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-50d1f98f-c607-415d-954c-892b4c5d0ae4 req-fab7b05d-083f-4ec6-acd8-76f684095b78 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-50d1f98f-c607-415d-954c-892b4c5d0ae4 req-fab7b05d-083f-4ec6-acd8-76f684095b78 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-50d1f98f-c607-415d-954c-892b4c5d0ae4 req-fab7b05d-083f-4ec6-acd8-76f684095b78 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:02:14 user nova-compute[74241]: WARNING nova.compute.manager [req-50d1f98f-c607-415d-954c-892b4c5d0ae4 req-fab7b05d-083f-4ec6-acd8-76f684095b78 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state building and task_state spawning.
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:02:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance destroyed successfully.
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:02:14 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:02:14 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=25.16140365600586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance spawned successfully.
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:02:14 user nova-compute[74241]: INFO nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Took 6.21 seconds to spawn the instance on the hypervisor.
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance faa206d7-8728-4df2-be7d-cd0cb9e01bae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 595814c8-bb69-474f-8d20-c765d6f03eab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:02:14 user nova-compute[74241]: INFO nova.compute.manager [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Took 57.98 seconds to build instance.
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4411c3f7-5516-4769-b388-a459d5fb11d4 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "595814c8-bb69-474f-8d20-c765d6f03eab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 58.085s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG nova.network.neutron [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:02:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 48613baf-40b5-4648-a8af-6d96ab7a245b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:02:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance destroyed successfully.
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lazy-loading 'resources' on Instance uuid faa206d7-8728-4df2-be7d-cd0cb9e01bae {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-994614910',display_name='tempest-TestShelveInstance-server-994614910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-994614910',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBGA8EIm8bdVJEoVP1A+o2QsEnh5s5Fjh3QwSwGdgU1grqVHyJ15uJYdk5fN9/WKU3de/G6oP6K5TbfThBalLdsEvW+DkCwTCM5GBB4EeMKPhzV/HKHJ94FJdzFG2kSA==',key_name='tempest-TestShelveInstance-535819981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d5e24daa11c4757afc2c27aa246d31d',ramdisk_id='',reservation_id='r-tfo5a02l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1406034018',owner_user_name='tempest-TestShelveInstance-1406034018-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:00:54Z,user_data=None,user_id='c95f4f751dd443059465a9c3daa01f52',uuid=faa206d7-8728-4df2-be7d-cd0cb9e01bae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converting VIF {"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG os_vif [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-336c114a-255b-49ab-bfb2-a0ef91e219bf req-d9a0f429-d5cb-4247-b418-9770bfe13163 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-336c114a-255b-49ab-bfb2-a0ef91e219bf req-d9a0f429-d5cb-4247-b418-9770bfe13163 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing instance network info cache due to event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-336c114a-255b-49ab-bfb2-a0ef91e219bf req-d9a0f429-d5cb-4247-b418-9770bfe13163 service nova] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-336c114a-255b-49ab-bfb2-a0ef91e219bf req-d9a0f429-d5cb-4247-b418-9770bfe13163 service nova] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.network.neutron [req-336c114a-255b-49ab-bfb2-a0ef91e219bf req-d9a0f429-d5cb-4247-b418-9770bfe13163 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa53098e1-97, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3dd1b300-acde-4722-8a21-8096395f756d) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:02:15 user nova-compute[74241]: INFO os_vif [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97')
Oct 20 12:02:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPiLNeGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:02:15 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:02:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5506185-279a-4804-8f30-d985721fe725]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:02:15 user nova-compute[74241]: No targets found.
Oct 20 12:02:15 user nova-compute[74241]: iSNS:
Oct 20 12:02:15 user nova-compute[74241]: No targets found.
Oct 20 12:02:15 user nova-compute[74241]: STATIC:
Oct 20 12:02:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74
Oct 20 12:02:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:02:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:02:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926
Oct 20 12:02:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:02:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:02:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:02:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:02:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:02:15 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb
Oct 20 12:02:15 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:02:15 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:02:15 user nova-compute[74241]: FIRMWARE:
Oct 20 12:02:15 user nova-compute[74241]: No targets found.
Oct 20 12:02:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:02:15 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:02:15 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b529c055-dd4f-4e42-9f90-be567e3cbd8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3791713d-4031-4cf0-ab0f-34c64bd237be]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:16 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:02:16 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:16 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:02:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:16 user nova-compute[74241]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:02:16 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:16 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:02:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52287767a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacde46e-eb57-4838-9d7d-806c190b9d93]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8624d84-5051-4c77-8c45-c4920b480565]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1776b7bc-5c90-4057-9525-97a7e0b6012d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ec1e41-206a-4e28-9dc7-79f3d82cc5f4]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e42edc5-6f91-4096-b653-bbdafc7de31f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5bab83-f798-4759-ac9b-573537c91274]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260]
Oct 20 12:02:16 user nova-compute[74241]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260] successful.
Oct 20 12:02:16 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2536a541-4235-4073-9862-ae8afd560c97]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] <== disconnect_volume: return (387ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:02:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Deleting instance files /opt/stack/data/nova/instances/faa206d7-8728-4df2-be7d-cd0cb9e01bae_del
Oct 20 12:02:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Deletion of /opt/stack/data/nova/instances/faa206d7-8728-4df2-be7d-cd0cb9e01bae_del complete
Oct 20 12:02:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-336c114a-255b-49ab-bfb2-a0ef91e219bf req-d9a0f429-d5cb-4247-b418-9770bfe13163 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updated VIF entry in instance network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-336c114a-255b-49ab-bfb2-a0ef91e219bf req-d9a0f429-d5cb-4247-b418-9770bfe13163 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": null, "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa53098e1-97", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-336c114a-255b-49ab-bfb2-a0ef91e219bf req-d9a0f429-d5cb-4247-b418-9770bfe13163 service nova] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updating instance_info_cache with network_info: [{"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:02:17 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Deleted allocations for instance faa206d7-8728-4df2-be7d-cd0cb9e01bae
Oct 20 12:02:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:17 user nova-compute[74241]: DEBUG nova.objects.instance [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lazy-loading 'numa_topology' on Instance uuid faa206d7-8728-4df2-be7d-cd0cb9e01bae {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:02:17 user nova-compute[74241]: DEBUG nova.objects.base [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Object Instance<faa206d7-8728-4df2-be7d-cd0cb9e01bae> lazy-loaded attributes: resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:02:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:02:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:02:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-4c917901-2fab-4ebb-a268-8989aa4340e2 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 8.446s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-00ca91b0-8619-4f4a-9d76-56ff5f92d761 req-fdb39cba-5ac7-4c6d-bcb2-ebc68ae877b2 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-changed-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-00ca91b0-8619-4f4a-9d76-56ff5f92d761 req-fdb39cba-5ac7-4c6d-bcb2-ebc68ae877b2 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Refreshing instance network info cache due to event network-changed-f8d95c60-7d6f-4149-97b8-a6058f80f69b. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-00ca91b0-8619-4f4a-9d76-56ff5f92d761 req-fdb39cba-5ac7-4c6d-bcb2-ebc68ae877b2 service nova] Acquiring lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-00ca91b0-8619-4f4a-9d76-56ff5f92d761 req-fdb39cba-5ac7-4c6d-bcb2-ebc68ae877b2 service nova] Acquired lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-00ca91b0-8619-4f4a-9d76-56ff5f92d761 req-fdb39cba-5ac7-4c6d-bcb2-ebc68ae877b2 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Refreshing network info cache for port f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'flavor' on Instance uuid 8c3d85a7-f4a9-4998-be6a-d50078f02658 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-00ca91b0-8619-4f4a-9d76-56ff5f92d761 req-fdb39cba-5ac7-4c6d-bcb2-ebc68ae877b2 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updated VIF entry in instance network info cache for port f8d95c60-7d6f-4149-97b8-a6058f80f69b. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-00ca91b0-8619-4f4a-9d76-56ff5f92d761 req-fdb39cba-5ac7-4c6d-bcb2-ebc68ae877b2 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updating instance_info_cache with network_info: [{"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-00ca91b0-8619-4f4a-9d76-56ff5f92d761 req-fdb39cba-5ac7-4c6d-bcb2-ebc68ae877b2 service nova] Releasing lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:02:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:21 user nova-compute[74241]: INFO nova.compute.manager [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Attaching volume ea818664-a471-49f4-8f14-bf42b840ecaa to /dev/vdb
Oct 20 12:02:21 user nova-compute[74241]: DEBUG os_brick.utils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[62245804-5b54-4b07-bebd-7d2cad6056fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f899c9-4fa3-4acc-ab42-5a431fd64a49]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[03620d81-348a-4557-8285-2747bc907847]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0875eaae-605f-40e2-891b-b77a95258482]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:02:21 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:02:21 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cd47d0-f34c-42a3-b83c-5d0495571546]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG os_brick.utils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:02:21 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updating existing volume attachment record: eb24a46c-b9cf-4e3c-abf7-83c3286c7e09 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:02:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:02:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIQjsCgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:02:42 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:02:42 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:02:42 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53036a7-dc19-451c-85d1-e673b29067e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:02:42 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e286f7a-c8ea-4cc7-939d-4ef52e11e507]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa] added
Oct 20 12:02:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.223s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[73de22d5-41fc-4c03-805f-9ead84ae23e1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[31429928-ccfc-49b0-8a0d-36a0b93c60a7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIQjsCgV {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UIQjsCgV" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc7b785-93ea-43c2-97c2-3b6068045f80]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UIQjsCgV'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31f7b32-622e-4af1-8edb-ba93c14d4e6a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc1dcd-f916-41c3-9bb8-acd1f42ce483]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91a4334-fd44-4522-8259-d615a2bfb5ab (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:42 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:42 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:02:42 user nova-compute[74241]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91a4334-fd44-4522-8259-d615a2bfb5ab (non-flash)
Oct 20 12:02:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:42 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:42 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:02:42 user nova-compute[74241]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91a4334-fd44-4522-8259-d615a2bfb5ab (non-flash)
Oct 20 12:02:42 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:02:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9120b732-077c-4b52-8eb6-66ef1d534506]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa, portal: 172.16.0.220,3260]
Oct 20 12:02:43 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa, portal: 172.16.0.220,3260] successful.
Oct 20 12:02:43 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f70104-a87f-40a8-906b-480a61b48c86]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[33345432-b758-42cf-ac97-a7d92f74b0b0]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91a4334-fd44-4522-8259-d615a2bfb5ab (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:43 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:43 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:02:43 user nova-compute[74241]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91a4334-fd44-4522-8259-d615a2bfb5ab (non-flash)
Oct 20 12:02:43 user nova-compute[74241]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa (non-flash)
Oct 20 12:02:43 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:02:43 user nova-compute[74241]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc241d6c-f36b-4c58-be03-a9ef1f441926 (non-flash)
Oct 20 12:02:43 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:02:43 user nova-compute[74241]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f91a4334-fd44-4522-8259-d615a2bfb5ab (non-flash)
Oct 20 12:02:43 user nova-compute[74241]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa (non-flash)
Oct 20 12:02:43 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.544s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c222c3-4a7e-44b1-9c99-697417f3d60f]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:02:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIQjsCgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.590s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] <== connect_volume: return (1591ms) {'type': 'block', 'scsi_wwn': '23237663235376337', 'path': '/dev/sdf'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237663235376337', 'path': '/dev/sdf'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG nova.objects.instance [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'flavor' on Instance uuid 8c3d85a7-f4a9-4998-be6a-d50078f02658 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 12:02:44 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:02:44 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 12:02:44 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:02:44 user nova-compute[74241]:   <serial>ea818664-a471-49f4-8f14-bf42b840ecaa</serial>
Oct 20 12:02:44 user nova-compute[74241]: </disk>
Oct 20 12:02:44 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No VIF found with MAC fa:16:3e:6c:6a:16, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:02:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-a68b8d8e-24d2-4214-90ca-526906b03fa9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.667s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:02:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:02:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:02:47 user nova-compute[74241]: INFO nova.compute.manager [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Detaching volume ea818664-a471-49f4-8f14-bf42b840ecaa
Oct 20 12:02:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:47 user nova-compute[74241]: INFO nova.virt.block_device [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Attempting to driver detach volume ea818664-a471-49f4-8f14-bf42b840ecaa from mountpoint /dev/vdb
Oct 20 12:02:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Attempting to detach device vdb from instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:02:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:02:47 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:02:47 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 12:02:47 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:02:47 user nova-compute[74241]:   <serial>ea818664-a471-49f4-8f14-bf42b840ecaa</serial>
Oct 20 12:02:47 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:02:47 user nova-compute[74241]: </disk>
Oct 20 12:02:47 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:02:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Successfully detached device vdb from instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 from the persistent domain config.
Oct 20 12:02:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:02:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:02:48 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:02:48 user nova-compute[74241]:   <source dev="/dev/sdf"/>
Oct 20 12:02:48 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:02:48 user nova-compute[74241]:   <serial>ea818664-a471-49f4-8f14-bf42b840ecaa</serial>
Oct 20 12:02:48 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:02:48 user nova-compute[74241]: </disk>
Oct 20 12:02:48 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:02:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:02:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:02:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:03:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:03:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:03:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:03:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:04 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:08 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 is timed out.
Oct 20 12:03:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Successfully detached device vdb from instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 from the live domain config.
Oct 20 12:03:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UIQjsCgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:03:08 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1816f8-b176-4d15-b2c7-4c061a0e4b7a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:03:08 user nova-compute[74241]: No targets found.
Oct 20 12:03:08 user nova-compute[74241]: iSNS:
Oct 20 12:03:08 user nova-compute[74241]: No targets found.
Oct 20 12:03:08 user nova-compute[74241]: STATIC:
Oct 20 12:03:08 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa
Oct 20 12:03:08 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:03:08 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:03:08 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:03:08 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:03:08 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:03:08 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb
Oct 20 12:03:08 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:03:08 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:03:08 user nova-compute[74241]: FIRMWARE:
Oct 20 12:03:08 user nova-compute[74241]: No targets found.
Oct 20 12:03:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:03:08 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:03:08 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[faefa98e-aa67-4faa-9a1c-87f0e938015c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d064be-f01c-4f25-8206-bce86a59f671]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:03:08 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:03:08 user nova-compute[74241]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa (non-flash)
Oct 20 12:03:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:03:08 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:03:08 user nova-compute[74241]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa (non-flash)
Oct 20 12:03:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52285f1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa'): ({'sdf'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Removing single pathed devices sdf {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[94503176-2d62-4d37-9217-93741ff43ca9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfac462-e3be-48b6-b6b3-29badd5d91c5]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Flushing IO for device /dev/sdf {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc481a4f-5d90-4aa6-8897-ded5f3a999e9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62cfd97-8192-4bfe-bfd5-ef7b68b7b8ae]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] SCSI volumes sdf have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6337807d-0284-4847-b053-da08d81bd8a4]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[67830a3a-5eb0-40fe-b8de-77738b3e0f4f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa, portal: 172.16.0.220,3260]
Oct 20 12:03:08 user nova-compute[74241]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa, portal: 172.16.0.220,3260] successful.
Oct 20 12:03:08 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea818664-a471-49f4-8f14-bf42b840ecaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1888ec-319d-4d2f-9b04-6cd3e094323d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] <== disconnect_volume: return (333ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:03:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:03:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:09 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:03:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:03:11 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:03:11 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8436MB free_disk=25.147769927978516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 595814c8-bb69-474f-8d20-c765d6f03eab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:03:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:03:13 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:14 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:14 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:03:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:03:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:03:14 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:03:15 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating instance_info_cache with network_info: [{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:03:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:03:15 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:03:15 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:15 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:03:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:23 user nova-compute[74241]: DEBUG nova.objects.instance [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'flavor' on Instance uuid 8c3d85a7-f4a9-4998-be6a-d50078f02658 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:03:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-b7c0302c-c563-47fb-b3e9-560a3aa7fa50 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 35.239s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:23 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:03:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "1803c43a-de8a-432b-a98e-2b3cdf72e514" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:03:27 user nova-compute[74241]: INFO nova.compute.claims [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Claim successful on node user
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:03:27 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:03:27 user nova-compute[74241]: INFO nova.virt.block_device [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Booting with volume 0037c894-2b45-4c51-9159-cb906752fb86 at /dev/vda
Oct 20 12:03:27 user nova-compute[74241]: DEBUG os_brick.utils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.policy [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf5346976b7f45e1b146911555f458eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6744161987c43408e35c847ec2055a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[12320b84-cead-4081-8aba-d89a95b994dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d03ff7-8cd7-4d01-a1d8-48ebe2c8a3b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[60529676-156a-4b75-93f1-7b7b2f1559c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb096b58-3de3-4ed6-a49e-ac903b726bec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:03:27 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:03:27 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e81442-6d65-4f76-aecc-a83ac356f88c]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG os_brick.utils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Updating existing volume attachment record: abd05094-d6e0-4263-be12-f58607159709 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:03:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:29 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Successfully created port: bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Successfully updated port: bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquired lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-bdb087d4-0997-4c60-b90b-a740c1489ad1 req-af7e62d6-22cd-4ef6-afdb-10b7fe15ff02 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received event network-changed-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-bdb087d4-0997-4c60-b90b-a740c1489ad1 req-af7e62d6-22cd-4ef6-afdb-10b7fe15ff02 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Refreshing instance network info cache due to event network-changed-bf83966d-d350-4695-87e3-dc66f3c89efb. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bdb087d4-0997-4c60-b90b-a740c1489ad1 req-af7e62d6-22cd-4ef6-afdb-10b7fe15ff02 service nova] Acquiring lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:03:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:31 user nova-compute[74241]: DEBUG nova.network.neutron [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Updating instance_info_cache with network_info: [{"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:03:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Releasing lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:03:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Instance network_info: |[{"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:03:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bdb087d4-0997-4c60-b90b-a740c1489ad1 req-af7e62d6-22cd-4ef6-afdb-10b7fe15ff02 service nova] Acquired lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:03:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-bdb087d4-0997-4c60-b90b-a740c1489ad1 req-af7e62d6-22cd-4ef6-afdb-10b7fe15ff02 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Refreshing network info cache for port bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:03:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-bdb087d4-0997-4c60-b90b-a740c1489ad1 req-af7e62d6-22cd-4ef6-afdb-10b7fe15ff02 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Updated VIF entry in instance network info cache for port bf83966d-d350-4695-87e3-dc66f3c89efb. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:03:31 user nova-compute[74241]: DEBUG nova.network.neutron [req-bdb087d4-0997-4c60-b90b-a740c1489ad1 req-af7e62d6-22cd-4ef6-afdb-10b7fe15ff02 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Updating instance_info_cache with network_info: [{"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:03:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bdb087d4-0997-4c60-b90b-a740c1489ad1 req-af7e62d6-22cd-4ef6-afdb-10b7fe15ff02 service nova] Releasing lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:03:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:03:42 user nova-compute[74241]: INFO nova.compute.claims [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Claim successful on node user
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:03:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.policy [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '922e09d51b734b829920133e2f331f5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2aef9fb6c554b21907299e277dad5df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:03:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Creating image(s)
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "/opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "/opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "/opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.205s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.213s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk 1073741824" returned: 0 in 0.053s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Cannot resize image /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Ensure instance console log exists: /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Successfully created port: b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Successfully updated port: b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquired lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-a74ff0d4-69ad-4526-bfe0-7514a065fcef req-1e8fc5f5-f0c9-44e8-b925-b8e917d1c463 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-changed-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-a74ff0d4-69ad-4526-bfe0-7514a065fcef req-1e8fc5f5-f0c9-44e8-b925-b8e917d1c463 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Refreshing instance network info cache due to event network-changed-b0bd4099-0208-462f-bf95-4fde5272d1ff. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a74ff0d4-69ad-4526-bfe0-7514a065fcef req-1e8fc5f5-f0c9-44e8-b925-b8e917d1c463 service nova] Acquiring lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating instance_info_cache with network_info: [{"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Releasing lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Instance network_info: |[{"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a74ff0d4-69ad-4526-bfe0-7514a065fcef req-1e8fc5f5-f0c9-44e8-b925-b8e917d1c463 service nova] Acquired lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-a74ff0d4-69ad-4526-bfe0-7514a065fcef req-1e8fc5f5-f0c9-44e8-b925-b8e917d1c463 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Refreshing network info cache for port b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Start _get_guest_xml network_info=[{"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:03:44 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:03:44 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-583210467',display_name='tempest-SnapshotDataIntegrityTests-server-583210467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-583210467',id=44,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQqFOs6E6TQq4NT5IgSRLMYBilFYnLRBHhicN9qI0SVH/7xU2VvXW48QSbSi1/QnylqFtTQBT2PvnDZeU0CFjhwj/XpomEt0JLbYBtLGxIvyaQvbTzbLnNATDLZKKnSUQ==',key_name='tempest-keypair-1015062290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2aef9fb6c554b21907299e277dad5df',ramdisk_id='',reservation_id='r-ef0iog84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1985280562',owner_user_name='tempest-SnapshotDataIntegrityTests-1985280562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='922e09d51b734b829920133e2f331f5f',uuid=6867fddf-3915-4ddc-b996-f003a4d46e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Converting VIF {"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a2:5a,bridge_name='br-int',has_traffic_filtering=True,id=b0bd4099-0208-462f-bf95-4fde5272d1ff,network=Network(bcc5fc78-7bad-4989-9f5a-d8c16a57a51e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bd4099-02') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.objects.instance [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'pci_devices' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:03:44 user nova-compute[74241]:   <uuid>6867fddf-3915-4ddc-b996-f003a4d46e99</uuid>
Oct 20 12:03:44 user nova-compute[74241]:   <name>instance-0000002c</name>
Oct 20 12:03:44 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:03:44 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:03:44 user nova-compute[74241]:   <metadata>
Oct 20 12:03:44 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:03:44 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:03:44 user nova-compute[74241]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-583210467</nova:name>
Oct 20 12:03:44 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:03:44</nova:creationTime>
Oct 20 12:03:44 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:03:44 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:03:44 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:03:44 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:03:44 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:03:44 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:03:44 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:03:44 user nova-compute[74241]:       <nova:owner>
Oct 20 12:03:44 user nova-compute[74241]:         <nova:user uuid="922e09d51b734b829920133e2f331f5f">tempest-SnapshotDataIntegrityTests-1985280562-project-member</nova:user>
Oct 20 12:03:44 user nova-compute[74241]:         <nova:project uuid="b2aef9fb6c554b21907299e277dad5df">tempest-SnapshotDataIntegrityTests-1985280562</nova:project>
Oct 20 12:03:44 user nova-compute[74241]:       </nova:owner>
Oct 20 12:03:44 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 12:03:44 user nova-compute[74241]:       <nova:ports>
Oct 20 12:03:44 user nova-compute[74241]:         <nova:port uuid="b0bd4099-0208-462f-bf95-4fde5272d1ff">
Oct 20 12:03:44 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 12:03:44 user nova-compute[74241]:         </nova:port>
Oct 20 12:03:44 user nova-compute[74241]:       </nova:ports>
Oct 20 12:03:44 user nova-compute[74241]:     </nova:instance>
Oct 20 12:03:44 user nova-compute[74241]:   </metadata>
Oct 20 12:03:44 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:03:44 user nova-compute[74241]:     <system>
Oct 20 12:03:44 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:03:44 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:03:44 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:03:44 user nova-compute[74241]:       <entry name="serial">6867fddf-3915-4ddc-b996-f003a4d46e99</entry>
Oct 20 12:03:44 user nova-compute[74241]:       <entry name="uuid">6867fddf-3915-4ddc-b996-f003a4d46e99</entry>
Oct 20 12:03:44 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:03:44 user nova-compute[74241]:     </system>
Oct 20 12:03:44 user nova-compute[74241]:   </sysinfo>
Oct 20 12:03:44 user nova-compute[74241]:   <os>
Oct 20 12:03:44 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:03:44 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:03:44 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:03:44 user nova-compute[74241]:   </os>
Oct 20 12:03:44 user nova-compute[74241]:   <features>
Oct 20 12:03:44 user nova-compute[74241]:     <acpi/>
Oct 20 12:03:44 user nova-compute[74241]:     <apic/>
Oct 20 12:03:44 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:03:44 user nova-compute[74241]:   </features>
Oct 20 12:03:44 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:03:44 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:03:44 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:03:44 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:03:44 user nova-compute[74241]:   </clock>
Oct 20 12:03:44 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:03:44 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:03:44 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:03:44 user nova-compute[74241]:   </cpu>
Oct 20 12:03:44 user nova-compute[74241]:   <devices>
Oct 20 12:03:44 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:03:44 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:03:44 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk"/>
Oct 20 12:03:44 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:03:44 user nova-compute[74241]:     </disk>
Oct 20 12:03:44 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:03:44 user nova-compute[74241]:       <mac address="fa:16:3e:61:a2:5a"/>
Oct 20 12:03:44 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:03:44 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:03:44 user nova-compute[74241]:       <target dev="tapb0bd4099-02"/>
Oct 20 12:03:44 user nova-compute[74241]:     </interface>
Oct 20 12:03:44 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:03:44 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/console.log" append="off"/>
Oct 20 12:03:44 user nova-compute[74241]:     </serial>
Oct 20 12:03:44 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:03:44 user nova-compute[74241]:     <video>
Oct 20 12:03:44 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:03:44 user nova-compute[74241]:     </video>
Oct 20 12:03:44 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:03:44 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:03:44 user nova-compute[74241]:     </rng>
Oct 20 12:03:44 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:03:44 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:03:44 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:03:44 user nova-compute[74241]:     </memballoon>
Oct 20 12:03:44 user nova-compute[74241]:   </devices>
Oct 20 12:03:44 user nova-compute[74241]: </domain>
Oct 20 12:03:44 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-583210467',display_name='tempest-SnapshotDataIntegrityTests-server-583210467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-583210467',id=44,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQqFOs6E6TQq4NT5IgSRLMYBilFYnLRBHhicN9qI0SVH/7xU2VvXW48QSbSi1/QnylqFtTQBT2PvnDZeU0CFjhwj/XpomEt0JLbYBtLGxIvyaQvbTzbLnNATDLZKKnSUQ==',key_name='tempest-keypair-1015062290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b2aef9fb6c554b21907299e277dad5df',ramdisk_id='',reservation_id='r-ef0iog84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1985280562',owner_user_name='tempest-SnapshotDataIntegrityTests-1985280562-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:03:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='922e09d51b734b829920133e2f331f5f',uuid=6867fddf-3915-4ddc-b996-f003a4d46e99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Converting VIF {"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:a2:5a,bridge_name='br-int',has_traffic_filtering=True,id=b0bd4099-0208-462f-bf95-4fde5272d1ff,network=Network(bcc5fc78-7bad-4989-9f5a-d8c16a57a51e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bd4099-02') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG os_vif [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a2:5a,bridge_name='br-int',has_traffic_filtering=True,id=b0bd4099-0208-462f-bf95-4fde5272d1ff,network=Network(bcc5fc78-7bad-4989-9f5a-d8c16a57a51e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bd4099-02') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92b192c6-887c-55bc-afb6-7a6439b646ae', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0bd4099-02, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0bd4099-02, col_values=(('qos', UUID('f3d9eb30-0ce3-48fe-92a6-6e0629357fd3')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0bd4099-02, col_values=(('external_ids', {'iface-id': 'b0bd4099-0208-462f-bf95-4fde5272d1ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:a2:5a', 'vm-uuid': '6867fddf-3915-4ddc-b996-f003a4d46e99'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:44 user nova-compute[74241]: INFO os_vif [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:a2:5a,bridge_name='br-int',has_traffic_filtering=True,id=b0bd4099-0208-462f-bf95-4fde5272d1ff,network=Network(bcc5fc78-7bad-4989-9f5a-d8c16a57a51e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bd4099-02')
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:03:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No VIF found with MAC fa:16:3e:61:a2:5a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:03:45 user nova-compute[74241]: DEBUG nova.network.neutron [req-a74ff0d4-69ad-4526-bfe0-7514a065fcef req-1e8fc5f5-f0c9-44e8-b925-b8e917d1c463 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updated VIF entry in instance network info cache for port b0bd4099-0208-462f-bf95-4fde5272d1ff. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:03:45 user nova-compute[74241]: DEBUG nova.network.neutron [req-a74ff0d4-69ad-4526-bfe0-7514a065fcef req-1e8fc5f5-f0c9-44e8-b925-b8e917d1c463 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating instance_info_cache with network_info: [{"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:03:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a74ff0d4-69ad-4526-bfe0-7514a065fcef req-1e8fc5f5-f0c9-44e8-b925-b8e917d1c463 service nova] Releasing lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:03:46 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Creating image(s)
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Ensure instance console log exists: /opt/stack/data/nova/instances/1803c43a-de8a-432b-a98e-2b3cdf72e514/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Start _get_guest_xml network_info=[{"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'abd05094-d6e0-4263-be12-f58607159709', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQUdOwuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1803c43a-de8a-432b-a98e-2b3cdf72e514', 'attached_at': '', 'detached_at': '', 'volume_id': '0037c894-2b45-4c51-9159-cb906752fb86', 'serial': '0037c894-2b45-4c51-9159-cb906752fb86'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:03:46 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:03:46 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQUdOwuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:03:46 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:03:46 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:03:46 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb55d9f-f5a8-4f0d-8e33-d09ee7bd8905]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:03:46 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c218f727-568f-45f6-b2b7-72b86a1092be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86] added
Oct 20 12:03:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.059s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46c0c6d-5866-4d09-9bc0-056452909ce7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae42fb4-5932-4db9-b9a4-e29fc951e644]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQUdOwuW {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EQUdOwuW" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9e2f36-5cc2-4ef0-9966-4bf1027e74d1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EQUdOwuW'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabd0563-af62-4b79-badb-5cbfec3b8812]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf1c9de-a810-44dc-8c56-b9d4b6c519cd]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:03:46 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:03:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:03:46 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:03:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dfbe85-6f64-405d-ad5f-a8d1715d254c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86, portal: 172.16.0.220,3260]
Oct 20 12:03:46 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86, portal: 172.16.0.220,3260] successful.
Oct 20 12:03:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-edab8a6c-6bbe-4545-b9d9-ba0a0e86c3cd req-c6639525-b9ed-4d0f-af1e-922885fdb56a service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-edab8a6c-6bbe-4545-b9d9-ba0a0e86c3cd req-c6639525-b9ed-4d0f-af1e-922885fdb56a service nova] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-edab8a6c-6bbe-4545-b9d9-ba0a0e86c3cd req-c6639525-b9ed-4d0f-af1e-922885fdb56a service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-edab8a6c-6bbe-4545-b9d9-ba0a0e86c3cd req-c6639525-b9ed-4d0f-af1e-922885fdb56a service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-edab8a6c-6bbe-4545-b9d9-ba0a0e86c3cd req-c6639525-b9ed-4d0f-af1e-922885fdb56a service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] No waiting events found dispatching network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:03:46 user nova-compute[74241]: WARNING nova.compute.manager [req-edab8a6c-6bbe-4545-b9d9-ba0a0e86c3cd req-c6639525-b9ed-4d0f-af1e-922885fdb56a service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received unexpected event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff for instance with vm_state building and task_state spawning.
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7816b-df32-4821-926f-ae93895a59f1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f8c39-4b4e-45b5-9dce-dc56947ad86f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:03:46 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:03:46 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:03:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:03:46 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:03:46 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:03:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9cfa6f-015a-493b-982e-0d8005378779]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQUdOwuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26132323530366132', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132323530366132', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1195578327',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1195578327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1195578327',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZKdjT9XujEi7YMnCHBw8h7cQ5KsTelEYfokG4rluySPp2ZxbftpFQwNjKz8asC2Ru2v/eD8+3UWJ724cgPGCr7v0BHh3NqXVKF3cyn4o+qqib1sNIEhb+6JL33OfIvfg==',key_name='tempest-keypair-2126739835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-tqxdoous',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf5346976b7f45e1b146911555f458eb',uuid=1803c43a-de8a-432b-a98e-2b3cdf72e514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d7:5c,bridge_name='br-int',has_traffic_filtering=True,id=bf83966d-d350-4695-87e3-dc66f3c89efb,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf83966d-d3') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'pci_devices' on Instance uuid 1803c43a-de8a-432b-a98e-2b3cdf72e514 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:03:47 user nova-compute[74241]:   <uuid>1803c43a-de8a-432b-a98e-2b3cdf72e514</uuid>
Oct 20 12:03:47 user nova-compute[74241]:   <name>instance-0000002b</name>
Oct 20 12:03:47 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:03:47 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:03:47 user nova-compute[74241]:   <metadata>
Oct 20 12:03:47 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:03:47 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:03:47 user nova-compute[74241]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1195578327</nova:name>
Oct 20 12:03:47 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:03:46</nova:creationTime>
Oct 20 12:03:47 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:03:47 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:03:47 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:03:47 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:03:47 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:03:47 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:03:47 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:03:47 user nova-compute[74241]:       <nova:owner>
Oct 20 12:03:47 user nova-compute[74241]:         <nova:user uuid="bf5346976b7f45e1b146911555f458eb">tempest-TestVolumeBootPattern-71867186-project-member</nova:user>
Oct 20 12:03:47 user nova-compute[74241]:         <nova:project uuid="e6744161987c43408e35c847ec2055a5">tempest-TestVolumeBootPattern-71867186</nova:project>
Oct 20 12:03:47 user nova-compute[74241]:       </nova:owner>
Oct 20 12:03:47 user nova-compute[74241]:       <nova:ports>
Oct 20 12:03:47 user nova-compute[74241]:         <nova:port uuid="bf83966d-d350-4695-87e3-dc66f3c89efb">
Oct 20 12:03:47 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 12:03:47 user nova-compute[74241]:         </nova:port>
Oct 20 12:03:47 user nova-compute[74241]:       </nova:ports>
Oct 20 12:03:47 user nova-compute[74241]:     </nova:instance>
Oct 20 12:03:47 user nova-compute[74241]:   </metadata>
Oct 20 12:03:47 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:03:47 user nova-compute[74241]:     <system>
Oct 20 12:03:47 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:03:47 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:03:47 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:03:47 user nova-compute[74241]:       <entry name="serial">1803c43a-de8a-432b-a98e-2b3cdf72e514</entry>
Oct 20 12:03:47 user nova-compute[74241]:       <entry name="uuid">1803c43a-de8a-432b-a98e-2b3cdf72e514</entry>
Oct 20 12:03:47 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:03:47 user nova-compute[74241]:     </system>
Oct 20 12:03:47 user nova-compute[74241]:   </sysinfo>
Oct 20 12:03:47 user nova-compute[74241]:   <os>
Oct 20 12:03:47 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:03:47 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:03:47 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:03:47 user nova-compute[74241]:   </os>
Oct 20 12:03:47 user nova-compute[74241]:   <features>
Oct 20 12:03:47 user nova-compute[74241]:     <acpi/>
Oct 20 12:03:47 user nova-compute[74241]:     <apic/>
Oct 20 12:03:47 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:03:47 user nova-compute[74241]:   </features>
Oct 20 12:03:47 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:03:47 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:03:47 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:03:47 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:03:47 user nova-compute[74241]:   </clock>
Oct 20 12:03:47 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:03:47 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:03:47 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:03:47 user nova-compute[74241]:   </cpu>
Oct 20 12:03:47 user nova-compute[74241]:   <devices>
Oct 20 12:03:47 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:03:47 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:03:47 user nova-compute[74241]:       <source dev="/dev/sdb"/>
Oct 20 12:03:47 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:03:47 user nova-compute[74241]:       <serial>0037c894-2b45-4c51-9159-cb906752fb86</serial>
Oct 20 12:03:47 user nova-compute[74241]:     </disk>
Oct 20 12:03:47 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:03:47 user nova-compute[74241]:       <mac address="fa:16:3e:8a:d7:5c"/>
Oct 20 12:03:47 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:03:47 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:03:47 user nova-compute[74241]:       <target dev="tapbf83966d-d3"/>
Oct 20 12:03:47 user nova-compute[74241]:     </interface>
Oct 20 12:03:47 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:03:47 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/1803c43a-de8a-432b-a98e-2b3cdf72e514/console.log" append="off"/>
Oct 20 12:03:47 user nova-compute[74241]:     </serial>
Oct 20 12:03:47 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:03:47 user nova-compute[74241]:     <video>
Oct 20 12:03:47 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:03:47 user nova-compute[74241]:     </video>
Oct 20 12:03:47 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:03:47 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:03:47 user nova-compute[74241]:     </rng>
Oct 20 12:03:47 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:03:47 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:03:47 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:03:47 user nova-compute[74241]:     </memballoon>
Oct 20 12:03:47 user nova-compute[74241]:   </devices>
Oct 20 12:03:47 user nova-compute[74241]: </domain>
Oct 20 12:03:47 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1195578327',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1195578327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1195578327',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZKdjT9XujEi7YMnCHBw8h7cQ5KsTelEYfokG4rluySPp2ZxbftpFQwNjKz8asC2Ru2v/eD8+3UWJ724cgPGCr7v0BHh3NqXVKF3cyn4o+qqib1sNIEhb+6JL33OfIvfg==',key_name='tempest-keypair-2126739835',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-tqxdoous',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:03:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf5346976b7f45e1b146911555f458eb',uuid=1803c43a-de8a-432b-a98e-2b3cdf72e514,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d7:5c,bridge_name='br-int',has_traffic_filtering=True,id=bf83966d-d350-4695-87e3-dc66f3c89efb,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf83966d-d3') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG os_vif [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d7:5c,bridge_name='br-int',has_traffic_filtering=True,id=bf83966d-d350-4695-87e3-dc66f3c89efb,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf83966d-d3') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9192440c-4fde-5ab5-835a-155d07083ee2', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf83966d-d3, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf83966d-d3, col_values=(('qos', UUID('f4aa07b6-f914-41da-a23d-bd8274c20bf6')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf83966d-d3, col_values=(('external_ids', {'iface-id': 'bf83966d-d350-4695-87e3-dc66f3c89efb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:d7:5c', 'vm-uuid': '1803c43a-de8a-432b-a98e-2b3cdf72e514'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:47 user nova-compute[74241]: INFO os_vif [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d7:5c,bridge_name='br-int',has_traffic_filtering=True,id=bf83966d-d350-4695-87e3-dc66f3c89efb,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf83966d-d3')
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No VIF found with MAC fa:16:3e:8a:d7:5c, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:03:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:03:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Instance spawned successfully.
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-a958ea05-3648-4c45-b2e5-ff779ffbfe08 req-0f69c681-01b2-422f-860d-16333dc63202 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a958ea05-3648-4c45-b2e5-ff779ffbfe08 req-0f69c681-01b2-422f-860d-16333dc63202 service nova] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a958ea05-3648-4c45-b2e5-ff779ffbfe08 req-0f69c681-01b2-422f-860d-16333dc63202 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a958ea05-3648-4c45-b2e5-ff779ffbfe08 req-0f69c681-01b2-422f-860d-16333dc63202 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-a958ea05-3648-4c45-b2e5-ff779ffbfe08 req-0f69c681-01b2-422f-860d-16333dc63202 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] No waiting events found dispatching network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:03:48 user nova-compute[74241]: WARNING nova.compute.manager [req-a958ea05-3648-4c45-b2e5-ff779ffbfe08 req-0f69c681-01b2-422f-860d-16333dc63202 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received unexpected event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff for instance with vm_state building and task_state spawning.
Oct 20 12:03:48 user nova-compute[74241]: INFO nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Took 5.98 seconds to spawn the instance on the hypervisor.
Oct 20 12:03:48 user nova-compute[74241]: DEBUG nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:03:48 user nova-compute[74241]: INFO nova.compute.manager [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Took 6.70 seconds to build instance.
Oct 20 12:03:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bc9521c0-3a59-4929-8235-11ebebab75a4 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.806s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received event network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] Acquiring lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] No waiting events found dispatching network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:03:50 user nova-compute[74241]: WARNING nova.compute.manager [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received unexpected event network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb for instance with vm_state building and task_state spawning.
Oct 20 12:03:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received event network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] Acquiring lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] No waiting events found dispatching network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:03:50 user nova-compute[74241]: WARNING nova.compute.manager [req-d5fa862e-058b-4f9b-97b5-69c28032bd42 req-b74746a5-150c-47cd-b786-84757148fe62 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received unexpected event network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb for instance with vm_state building and task_state spawning.
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:03:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Instance spawned successfully.
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:03:51 user nova-compute[74241]: INFO nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Took 5.43 seconds to spawn the instance on the hypervisor.
Oct 20 12:03:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:03:51 user nova-compute[74241]: INFO nova.compute.manager [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Took 24.49 seconds to build instance.
Oct 20 12:03:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0a11712d-c421-4283-8715-a2478c00efb5 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.591s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:03:53 user nova-compute[74241]: INFO nova.compute.manager [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] instance snapshotting
Oct 20 12:03:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Beginning live snapshot process
Oct 20 12:03:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json -f qcow2 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json -f qcow2" returned: 0 in 0.212s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json -f qcow2 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsk2ajx7k/8d06cacdd4884c098adadeec11693de3.delta 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:55 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsk2ajx7k/8d06cacdd4884c098adadeec11693de3.delta 1073741824" returned: 0 in 0.220s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:55 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 12:03:55 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 12:03:56 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74241) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 12:03:56 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 12:03:56 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 12:03:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsk2ajx7k/8d06cacdd4884c098adadeec11693de3.delta /opt/stack/data/nova/instances/snapshots/tmpsk2ajx7k/8d06cacdd4884c098adadeec11693de3 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:03:56 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsk2ajx7k/8d06cacdd4884c098adadeec11693de3.delta /opt/stack/data/nova/instances/snapshots/tmpsk2ajx7k/8d06cacdd4884c098adadeec11693de3" returned: 0 in 0.318s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:03:56 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Snapshot extracted, beginning image upload
Oct 20 12:03:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:57 user nova-compute[74241]: INFO nova.compute.manager [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Rescuing
Oct 20 12:03:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:03:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquired lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:03:57 user nova-compute[74241]: DEBUG nova.network.neutron [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:03:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG nova.network.neutron [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updating instance_info_cache with network_info: [{"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Releasing lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-21bd270c-a3b2-406d-a335-d118ef46164c req-9319f340-cdcd-4584-930e-b1bebee640e3 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-21bd270c-a3b2-406d-a335-d118ef46164c req-9319f340-cdcd-4584-930e-b1bebee640e3 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-21bd270c-a3b2-406d-a335-d118ef46164c req-9319f340-cdcd-4584-930e-b1bebee640e3 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-21bd270c-a3b2-406d-a335-d118ef46164c req-9319f340-cdcd-4584-930e-b1bebee640e3 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:58 user nova-compute[74241]: DEBUG nova.compute.manager [req-21bd270c-a3b2-406d-a335-d118ef46164c req-9319f340-cdcd-4584-930e-b1bebee640e3 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:03:58 user nova-compute[74241]: WARNING nova.compute.manager [req-21bd270c-a3b2-406d-a335-d118ef46164c req-9319f340-cdcd-4584-930e-b1bebee640e3 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state active and task_state rescuing.
Oct 20 12:03:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:03:59 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance destroyed successfully.
Oct 20 12:03:59 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Attempting a stable device rescue
Oct 20 12:03:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74241) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 12:03:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance directory exists: not creating {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 12:03:59 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Creating image(s)
Oct 20 12:03:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "/opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "/opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:03:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "/opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:03:59 user nova-compute[74241]: DEBUG nova.objects.instance [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'trusted_certs' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:03:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "555f526a2fe6601af8bf6f2d52860e11d5306864" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:03:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "555f526a2fe6601af8bf6f2d52860e11d5306864" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Snapshot image upload complete
Oct 20 12:04:00 user nova-compute[74241]: INFO nova.compute.manager [None req-d207db04-7d8c-4844-b544-ab28e8a4738c tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Took 6.34 seconds to snapshot the instance on the hypervisor.
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864.part --force-share --output=json" returned: 0 in 0.210s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG nova.virt.images [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] 806c1a42-19b1-4047-a2c3-87a850c21ab1 was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864.part /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864.part /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864.converted" returned: 0 in 0.262s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-a75912fd-f614-4763-aee0-42de770c6dc5 req-17e165a2-c5fb-4338-b2b0-3fd40ed798bf service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a75912fd-f614-4763-aee0-42de770c6dc5 req-17e165a2-c5fb-4338-b2b0-3fd40ed798bf service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a75912fd-f614-4763-aee0-42de770c6dc5 req-17e165a2-c5fb-4338-b2b0-3fd40ed798bf service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-a75912fd-f614-4763-aee0-42de770c6dc5 req-17e165a2-c5fb-4338-b2b0-3fd40ed798bf service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-a75912fd-f614-4763-aee0-42de770c6dc5 req-17e165a2-c5fb-4338-b2b0-3fd40ed798bf service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:04:00 user nova-compute[74241]: WARNING nova.compute.manager [req-a75912fd-f614-4763-aee0-42de770c6dc5 req-17e165a2-c5fb-4338-b2b0-3fd40ed798bf service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state active and task_state rescuing.
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "555f526a2fe6601af8bf6f2d52860e11d5306864" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.639s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "555f526a2fe6601af8bf6f2d52860e11d5306864" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "555f526a2fe6601af8bf6f2d52860e11d5306864" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864 --force-share --output=json" returned: 0 in 0.203s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864,backing_fmt=raw /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864,backing_fmt=raw /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue" returned: 0 in 0.062s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "555f526a2fe6601af8bf6f2d52860e11d5306864" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'migration_context' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<595814c8-bb69-474f-8d20-c765d6f03eab> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Start _get_guest_xml network_info=[{"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "vif_mac": "fa:16:3e:95:16:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '806c1a42-19b1-4047-a2c3-87a850c21ab1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'd9cbe3ee-f488-45eb-be7d-d60c5cad6b3b', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPrnWgUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '595814c8-bb69-474f-8d20-c765d6f03eab', 'attached_at': '', 'detached_at': '', 'volume_id': '312aed4d-80f1-4986-b638-086851269efb', 'serial': '312aed4d-80f1-4986-b638-086851269efb'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'resources' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<595814c8-bb69-474f-8d20-c765d6f03eab> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'numa_topology' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<595814c8-bb69-474f-8d20-c765d6f03eab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:04:01 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:04:01 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'vcpu_model' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<595814c8-bb69-474f-8d20-c765d6f03eab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPrnWgUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:04:01 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:04:01 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:04:01 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d2a995-3270-4e25-8afe-629bd1c2bb0b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EPrnWgUm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 12:04:01 user nova-compute[74241]: node.name = iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb
Oct 20 12:04:01 user nova-compute[74241]: node.tpgt = -1
Oct 20 12:04:01 user nova-compute[74241]: node.startup = automatic
Oct 20 12:04:01 user nova-compute[74241]: node.leading_login = No
Oct 20 12:04:01 user nova-compute[74241]: iface.iscsi_ifacename = default
Oct 20 12:04:01 user nova-compute[74241]: iface.net_ifacename = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.ipaddress = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.prefix_len = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.hwaddress = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.transport_name = tcp
Oct 20 12:04:01 user nova-compute[74241]: iface.initiatorname = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.state = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.vlan_id = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.vlan_priority = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.vlan_state = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.iface_num = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.mtu = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.port = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.bootproto = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.subnet_mask = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.gateway = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.dhcp_alt_client_id = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.dhcp_dns = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.dhcp_learn_iqn = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.dhcp_vendor_id_state = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.dhcp_vendor_id = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.dhcp_slp_da = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.fragmentation = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.gratuitous_arp = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.incoming_forwarding = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.tos_state = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.tos = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.ttl = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.delayed_ack = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.tcp_nagle = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.tcp_wsf_state = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.tcp_wsf = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.tcp_timer_scale = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.tcp_timestamp = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.redirect = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.def_task_mgmt_timeout = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.header_digest = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.data_digest = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.immediate_data = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.initial_r2t = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.data_seq_inorder = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.data_pdu_inorder = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.erl = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.max_receive_data_len = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.first_burst_len = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.max_outstanding_r2t = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.max_burst_len = 0
Oct 20 12:04:01 user nova-compute[74241]: iface.chap_auth = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.bidi_chap = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.strict_login_compliance = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.discovery_auth = <empty>
Oct 20 12:04:01 user nova-compute[74241]: iface.discovery_logout = <empty>
Oct 20 12:04:01 user nova-compute[74241]: node.discovery_address = <empty>
Oct 20 12:04:01 user nova-compute[74241]: node.discovery_port = 0
Oct 20 12:04:01 user nova-compute[74241]: node.discovery_type = static
Oct 20 12:04:01 user nova-compute[74241]: node.session.initial_cmdsn = 0
Oct 20 12:04:01 user nova-compute[74241]: node.session.initial_login_retry_max = 8
Oct 20 12:04:01 user nova-compute[74241]: node.session.xmit_thread_priority = -20
Oct 20 12:04:01 user nova-compute[74241]: node.session.cmds_max = 128
Oct 20 12:04:01 user nova-compute[74241]: node.session.queue_depth = 32
Oct 20 12:04:01 user nova-compute[74241]: node.session.nr_sessions = 1
Oct 20 12:04:01 user nova-compute[74241]: node.session.auth.authmethod = CHAP
Oct 20 12:04:01 user nova-compute[74241]: node.session.auth.username = EPrnWgUm
Oct 20 12:04:01 user nova-compute[74241]: node.session.auth.password = ***
Oct 20 12:04:01 user nova-compute[74241]: node.session.auth.username_in = <empty>
Oct 20 12:04:01 user nova-compute[74241]: node.session.auth.password_in = <empty>
Oct 20 12:04:01 user nova-compute[74241]: node.session.auth.chap_algs = MD5
Oct 20 12:04:01 user nova-compute[74241]: node.session.timeo.replacement_timeout = 120
Oct 20 12:04:01 user nova-compute[74241]: node.session.err_timeo.abort_timeout = 15
Oct 20 12:04:01 user nova-compute[74241]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 12:04:01 user nova-compute[74241]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 12:04:01 user nova-compute[74241]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.FastAbort = Yes
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.InitialR2T = No
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.ImmediateData = Yes
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.MaxConnections = 1
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 12:04:01 user nova-compute[74241]: node.session.iscsi.ERL = 0
Oct 20 12:04:01 user nova-compute[74241]: node.session.scan = manual
Oct 20 12:04:01 user nova-compute[74241]: node.session.reopen_max = 0
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].address = 172.16.0.220
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].port = 3260
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].startup = manual
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].tcp.window_size = 524288
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].tcp.type_of_service = 0
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].timeo.logout_timeout = 15
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].timeo.login_timeout = 15
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].timeo.auth_timeout = 45
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].iscsi.DataDigest = None
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].iscsi.IFMarker = No
Oct 20 12:04:01 user nova-compute[74241]: node.conn[0].iscsi.OFMarker = No
Oct 20 12:04:01 user nova-compute[74241]: # END RECORD
Oct 20 12:04:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:01 user nova-compute[74241]: INFO nova.compute.manager [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Unshelving
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91dd162-99b0-4759-901c-1c4235105b39]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c039b2b-9f52-42ef-9a83-8c70d76ad9ff]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPrnWgUm {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPrnWgUm" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[584d938c-e511-4ae2-acad-e8bae616ad6a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EPrnWgUm'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ecfee1-1ac1-43f9-af2b-24289235ca97]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: INFO nova.virt.block_device [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Booting with volume d404e218-9f3e-4b3f-a04e-ee52ed206b74 at /dev/vda
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[109fe313-0e38-4b24-b728-d2d1cc3bc464]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:04:01 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:04:01 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:04:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:04:01 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:04:01 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:04:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.188s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] HCTL ('36', '0', '0', 0) found on session 44 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73e4b93-b2ca-46ce-88ec-cd5f1e67272f]: (4, ('0 0 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Searching for a device in session 44 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPrnWgUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.219s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] <== connect_volume: return (220ms) {'type': 'block', 'scsi_wwn': '23231313762333663', 'path': '/dev/sde'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231313762333663', 'path': '/dev/sde'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2111188889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2111188889',id=42,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:02:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-1qfjrz5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:02:14Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=595814c8-bb69-474f-8d20-c765d6f03eab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "vif_mac": "fa:16:3e:95:16:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "vif_mac": "fa:16:3e:95:16:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:16:68,bridge_name='br-int',has_traffic_filtering=True,id=9eaf149b-3d41-4c5f-ae86-015b6b0202cd,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eaf149b-3d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'pci_devices' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.objects.base [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Object Instance<595814c8-bb69-474f-8d20-c765d6f03eab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:04:01 user nova-compute[74241]:   <uuid>595814c8-bb69-474f-8d20-c765d6f03eab</uuid>
Oct 20 12:04:01 user nova-compute[74241]:   <name>instance-0000002a</name>
Oct 20 12:04:01 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:04:01 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:04:01 user nova-compute[74241]:   <metadata>
Oct 20 12:04:01 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:04:01 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:04:01 user nova-compute[74241]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2111188889</nova:name>
Oct 20 12:04:01 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:04:01</nova:creationTime>
Oct 20 12:04:01 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:04:01 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:04:01 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:04:01 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:04:01 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:04:01 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:04:01 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:04:01 user nova-compute[74241]:       <nova:owner>
Oct 20 12:04:01 user nova-compute[74241]:         <nova:user uuid="0c611c28a9264820a26f203045040420">tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member</nova:user>
Oct 20 12:04:01 user nova-compute[74241]:         <nova:project uuid="52f8151a0cf44b2d89838da474c2dc68">tempest-ServerBootFromVolumeStableRescueTest-929360393</nova:project>
Oct 20 12:04:01 user nova-compute[74241]:       </nova:owner>
Oct 20 12:04:01 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 12:04:01 user nova-compute[74241]:       <nova:ports>
Oct 20 12:04:01 user nova-compute[74241]:         <nova:port uuid="9eaf149b-3d41-4c5f-ae86-015b6b0202cd">
Oct 20 12:04:01 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 12:04:01 user nova-compute[74241]:         </nova:port>
Oct 20 12:04:01 user nova-compute[74241]:       </nova:ports>
Oct 20 12:04:01 user nova-compute[74241]:     </nova:instance>
Oct 20 12:04:01 user nova-compute[74241]:   </metadata>
Oct 20 12:04:01 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:04:01 user nova-compute[74241]:     <system>
Oct 20 12:04:01 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:04:01 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:04:01 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:04:01 user nova-compute[74241]:       <entry name="serial">595814c8-bb69-474f-8d20-c765d6f03eab</entry>
Oct 20 12:04:01 user nova-compute[74241]:       <entry name="uuid">595814c8-bb69-474f-8d20-c765d6f03eab</entry>
Oct 20 12:04:01 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:04:01 user nova-compute[74241]:     </system>
Oct 20 12:04:01 user nova-compute[74241]:   </sysinfo>
Oct 20 12:04:01 user nova-compute[74241]:   <os>
Oct 20 12:04:01 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:04:01 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:04:01 user nova-compute[74241]:   </os>
Oct 20 12:04:01 user nova-compute[74241]:   <features>
Oct 20 12:04:01 user nova-compute[74241]:     <acpi/>
Oct 20 12:04:01 user nova-compute[74241]:     <apic/>
Oct 20 12:04:01 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:04:01 user nova-compute[74241]:   </features>
Oct 20 12:04:01 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:04:01 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:04:01 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:04:01 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:04:01 user nova-compute[74241]:   </clock>
Oct 20 12:04:01 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:04:01 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:04:01 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:04:01 user nova-compute[74241]:   </cpu>
Oct 20 12:04:01 user nova-compute[74241]:   <devices>
Oct 20 12:04:01 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:04:01 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:04:01 user nova-compute[74241]:       <source dev="/dev/sde"/>
Oct 20 12:04:01 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:04:01 user nova-compute[74241]:       <serial>312aed4d-80f1-4986-b638-086851269efb</serial>
Oct 20 12:04:01 user nova-compute[74241]:     </disk>
Oct 20 12:04:01 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:04:01 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:04:01 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue"/>
Oct 20 12:04:01 user nova-compute[74241]:       <target dev="vdb" bus="virtio"/>
Oct 20 12:04:01 user nova-compute[74241]:       <boot order="1"/>
Oct 20 12:04:01 user nova-compute[74241]:     </disk>
Oct 20 12:04:01 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:04:01 user nova-compute[74241]:       <mac address="fa:16:3e:95:16:68"/>
Oct 20 12:04:01 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:04:01 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:04:01 user nova-compute[74241]:       <target dev="tap9eaf149b-3d"/>
Oct 20 12:04:01 user nova-compute[74241]:     </interface>
Oct 20 12:04:01 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:04:01 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/console.log" append="off"/>
Oct 20 12:04:01 user nova-compute[74241]:     </serial>
Oct 20 12:04:01 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:04:01 user nova-compute[74241]:     <video>
Oct 20 12:04:01 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:04:01 user nova-compute[74241]:     </video>
Oct 20 12:04:01 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:04:01 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:04:01 user nova-compute[74241]:     </rng>
Oct 20 12:04:01 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:04:01 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:04:01 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:04:01 user nova-compute[74241]:     </memballoon>
Oct 20 12:04:01 user nova-compute[74241]:   </devices>
Oct 20 12:04:01 user nova-compute[74241]: </domain>
Oct 20 12:04:01 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.utils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance destroyed successfully.
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a76cd-b845-41c2-84cf-392458d67408]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8a5a94-35fa-4ef9-8a26-a8c277000ccf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfbe46c-9032-4c46-bad4-d26247fb5186]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b62981-08a5-4c0b-96af-c093c45048c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] No VIF found with MAC fa:16:3e:95:16:68, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:04:01 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:04:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[204efd2c-4488-439b-b410-2ed27d393af1]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG os_brick.utils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:04:01 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating existing volume attachment record: 7f89ef6f-940e-4f2d-bd45-b259a40aa1ea {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:04:02 user nova-compute[74241]: INFO nova.compute.claims [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Claim successful on node user
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.network.neutron [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:04:02 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:04:02 user nova-compute[74241]: DEBUG nova.policy [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96bd8e533fb44c298f5ef17bbbd6ef5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12c1d28fe5a7414ca1aa84dbd092eb26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:04:03 user nova-compute[74241]: DEBUG nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:04:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:04:03 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Creating image(s)
Oct 20 12:04:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "/opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "/opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "46a20eb8fbcf0150e71c71faa522f359400860fb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "46a20eb8fbcf0150e71c71faa522f359400860fb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f8464e2-9234-41f8-ac22-66399a380ec1 req-3ae07f24-fc1f-40ec-88e4-92a902f5e47f service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f8464e2-9234-41f8-ac22-66399a380ec1 req-3ae07f24-fc1f-40ec-88e4-92a902f5e47f service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f8464e2-9234-41f8-ac22-66399a380ec1 req-3ae07f24-fc1f-40ec-88e4-92a902f5e47f service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-3f8464e2-9234-41f8-ac22-66399a380ec1 req-3ae07f24-fc1f-40ec-88e4-92a902f5e47f service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-3f8464e2-9234-41f8-ac22-66399a380ec1 req-3ae07f24-fc1f-40ec-88e4-92a902f5e47f service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:04:04 user nova-compute[74241]: WARNING nova.compute.manager [req-3f8464e2-9234-41f8-ac22-66399a380ec1 req-3ae07f24-fc1f-40ec-88e4-92a902f5e47f service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state active and task_state rescuing.
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG nova.virt.images [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] 1958aba5-1350-4ab1-920b-7ed9cb13578d was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb.part /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG nova.network.neutron [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Successfully created port: d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb.part /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb.converted" returned: 0 in 0.273s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "46a20eb8fbcf0150e71c71faa522f359400860fb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.815s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:04 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "46a20eb8fbcf0150e71c71faa522f359400860fb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "46a20eb8fbcf0150e71c71faa522f359400860fb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Successfully updated port: d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquired lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb,backing_fmt=raw /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb,backing_fmt=raw /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk 1073741824" returned: 0 in 0.056s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "46a20eb8fbcf0150e71c71faa522f359400860fb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Ensure instance console log exists: /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.neutron [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updating instance_info_cache with network_info: [{"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Releasing lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Instance network_info: |[{"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Start _get_guest_xml network_info=[{"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='189057d1731f20f91bbe7f72c86892e6',container_format='bare',created_at=2023-10-20T12:03:54Z,direct_url=<?>,disk_format='qcow2',id=1958aba5-1350-4ab1-920b-7ed9cb13578d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1206356818',owner='12c1d28fe5a7414ca1aa84dbd092eb26',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T12:04:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': '1958aba5-1350-4ab1-920b-7ed9cb13578d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:04:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:04:05 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='189057d1731f20f91bbe7f72c86892e6',container_format='bare',created_at=2023-10-20T12:03:54Z,direct_url=<?>,disk_format='qcow2',id=1958aba5-1350-4ab1-920b-7ed9cb13578d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1206356818',owner='12c1d28fe5a7414ca1aa84dbd092eb26',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T12:04:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1017554264',display_name='tempest-TestStampPattern-server-1017554264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1017554264',id=45,image_ref='1958aba5-1350-4ab1-920b-7ed9cb13578d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKjNjBfodxRSr5YvavNS/uQaM3H/sSuwdLpiLie0Gc+zlYN3eiXZGDk/CPuRUr1nTvtuenQYt1ietTjwkbxk07PqaQmzMx7LgbHmAAcY8qdVSzmBI9C6xbIafIRctDz+Q==',key_name='tempest-TestStampPattern-37297663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12c1d28fe5a7414ca1aa84dbd092eb26',ramdisk_id='',reservation_id='r-adyj0ahi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8c3d85a7-f4a9-4998-be6a-d50078f02658',image_min_disk='1',image_min_ram='0',image_owner_id='12c1d28fe5a7414ca1aa84dbd092eb26',image_owner_project_name='tempest-TestStampPattern-372523597',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-372523597-project-member',image_user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',network_allocated='True',owner_project_name='tempest-TestStampPattern-372523597',owner_user_name='tempest-TestStampPattern-372523597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:04:03Z,user_data=None,user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',uuid=fc3d7431-755e-4fb5-8c3a-21d5feee64fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converting VIF {"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:34:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3a58115-3288-4a06-bd61-c751232bb9d1,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a58115-32') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.objects.instance [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'pci_devices' on Instance uuid fc3d7431-755e-4fb5-8c3a-21d5feee64fc {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:04:05 user nova-compute[74241]:   <uuid>fc3d7431-755e-4fb5-8c3a-21d5feee64fc</uuid>
Oct 20 12:04:05 user nova-compute[74241]:   <name>instance-0000002d</name>
Oct 20 12:04:05 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:04:05 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:04:05 user nova-compute[74241]:   <metadata>
Oct 20 12:04:05 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:04:05 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:04:05 user nova-compute[74241]:       <nova:name>tempest-TestStampPattern-server-1017554264</nova:name>
Oct 20 12:04:05 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:04:05</nova:creationTime>
Oct 20 12:04:05 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:04:05 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:04:05 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:04:05 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:04:05 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:04:05 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:04:05 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:04:05 user nova-compute[74241]:       <nova:owner>
Oct 20 12:04:05 user nova-compute[74241]:         <nova:user uuid="96bd8e533fb44c298f5ef17bbbd6ef5b">tempest-TestStampPattern-372523597-project-member</nova:user>
Oct 20 12:04:05 user nova-compute[74241]:         <nova:project uuid="12c1d28fe5a7414ca1aa84dbd092eb26">tempest-TestStampPattern-372523597</nova:project>
Oct 20 12:04:05 user nova-compute[74241]:       </nova:owner>
Oct 20 12:04:05 user nova-compute[74241]:       <nova:root type="image" uuid="1958aba5-1350-4ab1-920b-7ed9cb13578d"/>
Oct 20 12:04:05 user nova-compute[74241]:       <nova:ports>
Oct 20 12:04:05 user nova-compute[74241]:         <nova:port uuid="d3a58115-3288-4a06-bd61-c751232bb9d1">
Oct 20 12:04:05 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 12:04:05 user nova-compute[74241]:         </nova:port>
Oct 20 12:04:05 user nova-compute[74241]:       </nova:ports>
Oct 20 12:04:05 user nova-compute[74241]:     </nova:instance>
Oct 20 12:04:05 user nova-compute[74241]:   </metadata>
Oct 20 12:04:05 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:04:05 user nova-compute[74241]:     <system>
Oct 20 12:04:05 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:04:05 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:04:05 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:04:05 user nova-compute[74241]:       <entry name="serial">fc3d7431-755e-4fb5-8c3a-21d5feee64fc</entry>
Oct 20 12:04:05 user nova-compute[74241]:       <entry name="uuid">fc3d7431-755e-4fb5-8c3a-21d5feee64fc</entry>
Oct 20 12:04:05 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:04:05 user nova-compute[74241]:     </system>
Oct 20 12:04:05 user nova-compute[74241]:   </sysinfo>
Oct 20 12:04:05 user nova-compute[74241]:   <os>
Oct 20 12:04:05 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:04:05 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:04:05 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:04:05 user nova-compute[74241]:   </os>
Oct 20 12:04:05 user nova-compute[74241]:   <features>
Oct 20 12:04:05 user nova-compute[74241]:     <acpi/>
Oct 20 12:04:05 user nova-compute[74241]:     <apic/>
Oct 20 12:04:05 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:04:05 user nova-compute[74241]:   </features>
Oct 20 12:04:05 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:04:05 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:04:05 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:04:05 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:04:05 user nova-compute[74241]:   </clock>
Oct 20 12:04:05 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:04:05 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:04:05 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:04:05 user nova-compute[74241]:   </cpu>
Oct 20 12:04:05 user nova-compute[74241]:   <devices>
Oct 20 12:04:05 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:04:05 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:04:05 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk"/>
Oct 20 12:04:05 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:04:05 user nova-compute[74241]:     </disk>
Oct 20 12:04:05 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:04:05 user nova-compute[74241]:       <mac address="fa:16:3e:99:34:8b"/>
Oct 20 12:04:05 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:04:05 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:04:05 user nova-compute[74241]:       <target dev="tapd3a58115-32"/>
Oct 20 12:04:05 user nova-compute[74241]:     </interface>
Oct 20 12:04:05 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:04:05 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/console.log" append="off"/>
Oct 20 12:04:05 user nova-compute[74241]:     </serial>
Oct 20 12:04:05 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:04:05 user nova-compute[74241]:     <video>
Oct 20 12:04:05 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:04:05 user nova-compute[74241]:     </video>
Oct 20 12:04:05 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:04:05 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:04:05 user nova-compute[74241]:     </rng>
Oct 20 12:04:05 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:04:05 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:04:05 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:04:05 user nova-compute[74241]:     </memballoon>
Oct 20 12:04:05 user nova-compute[74241]:   </devices>
Oct 20 12:04:05 user nova-compute[74241]: </domain>
Oct 20 12:04:05 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1017554264',display_name='tempest-TestStampPattern-server-1017554264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1017554264',id=45,image_ref='1958aba5-1350-4ab1-920b-7ed9cb13578d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKjNjBfodxRSr5YvavNS/uQaM3H/sSuwdLpiLie0Gc+zlYN3eiXZGDk/CPuRUr1nTvtuenQYt1ietTjwkbxk07PqaQmzMx7LgbHmAAcY8qdVSzmBI9C6xbIafIRctDz+Q==',key_name='tempest-TestStampPattern-37297663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12c1d28fe5a7414ca1aa84dbd092eb26',ramdisk_id='',reservation_id='r-adyj0ahi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8c3d85a7-f4a9-4998-be6a-d50078f02658',image_min_disk='1',image_min_ram='0',image_owner_id='12c1d28fe5a7414ca1aa84dbd092eb26',image_owner_project_name='tempest-TestStampPattern-372523597',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-372523597-project-member',image_user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',network_allocated='True',owner_project_name='tempest-TestStampPattern-372523597',owner_user_name='tempest-TestStampPattern-372523597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:04:03Z,user_data=None,user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',uuid=fc3d7431-755e-4fb5-8c3a-21d5feee64fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converting VIF {"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:34:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3a58115-3288-4a06-bd61-c751232bb9d1,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a58115-32') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG os_vif [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:34:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3a58115-3288-4a06-bd61-c751232bb9d1,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a58115-32') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53d5d604-c6c0-52bc-bc78-0fb51492bb82', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:04:05 user nova-compute[74241]: WARNING nova.compute.manager [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state active and task_state rescuing.
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received event network-changed-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.compute.manager [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Refreshing instance network info cache due to event network-changed-d3a58115-3288-4a06-bd61-c751232bb9d1. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] Acquiring lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] Acquired lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.network.neutron [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Refreshing network info cache for port d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3a58115-32, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3a58115-32, col_values=(('qos', UUID('55f9c9b0-68bd-4752-bb75-619e8dd3f9e0')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3a58115-32, col_values=(('external_ids', {'iface-id': 'd3a58115-3288-4a06-bd61-c751232bb9d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:34:8b', 'vm-uuid': 'fc3d7431-755e-4fb5-8c3a-21d5feee64fc'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:05 user nova-compute[74241]: INFO os_vif [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:34:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3a58115-3288-4a06-bd61-c751232bb9d1,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a58115-32')
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.compute.manager [None req-3f90fe6f-8c34-4c62-8f1f-b65ad495759c tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:04:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No VIF found with MAC fa:16:3e:99:34:8b, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:04:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updated VIF entry in instance network info cache for port d3a58115-3288-4a06-bd61-c751232bb9d1. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:04:06 user nova-compute[74241]: DEBUG nova.network.neutron [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updating instance_info_cache with network_info: [{"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:04:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-782dfabb-f78c-4df1-9560-740abe3de1b0 req-04234b2a-4d7f-4b64-b909-82d624c5aff5 service nova] Releasing lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:04:06 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-96047080-1e87-4795-9393-f62c9e9045f5 req-508f7f3c-9dce-4938-9578-3016453cbb3b service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received event network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-96047080-1e87-4795-9393-f62c9e9045f5 req-508f7f3c-9dce-4938-9578-3016453cbb3b service nova] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-96047080-1e87-4795-9393-f62c9e9045f5 req-508f7f3c-9dce-4938-9578-3016453cbb3b service nova] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-96047080-1e87-4795-9393-f62c9e9045f5 req-508f7f3c-9dce-4938-9578-3016453cbb3b service nova] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-96047080-1e87-4795-9393-f62c9e9045f5 req-508f7f3c-9dce-4938-9578-3016453cbb3b service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] No waiting events found dispatching network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:04:07 user nova-compute[74241]: WARNING nova.compute.manager [req-96047080-1e87-4795-9393-f62c9e9045f5 req-508f7f3c-9dce-4938-9578-3016453cbb3b service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received unexpected event network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 for instance with vm_state building and task_state spawning.
Oct 20 12:04:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-b23cc16e-2c93-434b-8766-ba614dd80084 req-0effe4e0-0a73-44bf-bc6a-a6dfd3b124b2 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received event network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b23cc16e-2c93-434b-8766-ba614dd80084 req-0effe4e0-0a73-44bf-bc6a-a6dfd3b124b2 service nova] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b23cc16e-2c93-434b-8766-ba614dd80084 req-0effe4e0-0a73-44bf-bc6a-a6dfd3b124b2 service nova] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b23cc16e-2c93-434b-8766-ba614dd80084 req-0effe4e0-0a73-44bf-bc6a-a6dfd3b124b2 service nova] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-b23cc16e-2c93-434b-8766-ba614dd80084 req-0effe4e0-0a73-44bf-bc6a-a6dfd3b124b2 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] No waiting events found dispatching network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:04:09 user nova-compute[74241]: WARNING nova.compute.manager [req-b23cc16e-2c93-434b-8766-ba614dd80084 req-0effe4e0-0a73-44bf-bc6a-a6dfd3b124b2 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received unexpected event network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 for instance with vm_state building and task_state spawning.
Oct 20 12:04:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:04:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:04:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Instance spawned successfully.
Oct 20 12:04:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:04:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:04:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:04:10 user nova-compute[74241]: INFO nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Took 7.28 seconds to spawn the instance on the hypervisor.
Oct 20 12:04:10 user nova-compute[74241]: DEBUG nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:04:10 user nova-compute[74241]: INFO nova.compute.manager [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Took 8.23 seconds to build instance.
Oct 20 12:04:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-36b87ed7-a3b3-4d34-a231-a5090c3e49f9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.390s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:04:11 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:14 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:04:14 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:04:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8039MB free_disk=24.869239807128906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:04:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 595814c8-bb69-474f-8d20-c765d6f03eab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 1803c43a-de8a-432b-a98e-2b3cdf72e514 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance faa206d7-8728-4df2-be7d-cd0cb9e01bae has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:04:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.041s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:04:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:04:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:04:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Updating instance_info_cache with network_info: [{"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 12:04:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:23 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:25 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:04:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 12:04:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lazy-loading 'pci_requests' on Instance uuid faa206d7-8728-4df2-be7d-cd0cb9e01bae {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lazy-loading 'numa_topology' on Instance uuid faa206d7-8728-4df2-be7d-cd0cb9e01bae {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:04:31 user nova-compute[74241]: INFO nova.compute.claims [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Claim successful on node user
Oct 20 12:04:31 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:04:31 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:04:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:32 user nova-compute[74241]: INFO nova.network.neutron [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating port a53098e1-97f5-4c14-aeb6-7883ab442ca2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 12:04:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:04:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:04:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:04:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-4bc0d206-f6c4-44af-bc4d-f2856c2c825f req-931ad788-cde1-44bb-8cc6-f82c83af1ffe service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-4bc0d206-f6c4-44af-bc4d-f2856c2c825f req-931ad788-cde1-44bb-8cc6-f82c83af1ffe service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing instance network info cache due to event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:04:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4bc0d206-f6c4-44af-bc4d-f2856c2c825f req-931ad788-cde1-44bb-8cc6-f82c83af1ffe service nova] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:04:33 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Creating image(s)
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Ensure instance console log exists: /opt/stack/data/nova/instances/faa206d7-8728-4df2-be7d-cd0cb9e01bae/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Start _get_guest_xml network_info=[{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '7f89ef6f-940e-4f2d-bd45-b259a40aa1ea', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPiLNeGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'faa206d7-8728-4df2-be7d-cd0cb9e01bae', 'attached_at': '', 'detached_at': '', 'volume_id': 'd404e218-9f3e-4b3f-a04e-ee52ed206b74', 'serial': 'd404e218-9f3e-4b3f-a04e-ee52ed206b74'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4bc0d206-f6c4-44af-bc4d-f2856c2c825f req-931ad788-cde1-44bb-8cc6-f82c83af1ffe service nova] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-4bc0d206-f6c4-44af-bc4d-f2856c2c825f req-931ad788-cde1-44bb-8cc6-f82c83af1ffe service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:04:33 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:04:33 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.objects.instance [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lazy-loading 'vcpu_model' on Instance uuid faa206d7-8728-4df2-be7d-cd0cb9e01bae {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.objects.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Object Instance<faa206d7-8728-4df2-be7d-cd0cb9e01bae> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPiLNeGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:04:33 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:04:33 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:04:33 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[85003d07-6a41-4174-9e39-75e5001bb762]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:04:33 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20d1609-74b0-4a03-b53a-7c15dd8a8160]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74] added
Oct 20 12:04:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f1bbc5-db80-4841-b44c-6f88a077ad04]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf0a531-a4b4-490e-b318-6f557ac09408]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPiLNeGu {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EPiLNeGu" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ffc181-dc75-4b75-b3b9-2456cb667110]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EPiLNeGu'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0747b003-ccdf-4ceb-8c46-2a691da8249d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[218c7e19-9c56-4023-9fde-71144c5ba51a]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[533612ee-1afd-4f29-8fe4-752e94cb69b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260]
Oct 20 12:04:33 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260] successful.
Oct 20 12:04:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b59e19-1b77-4521-b0cd-a6c6ef8bf549]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6467349a-c500-44ec-88c4-a0835256cf61]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:04:33 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-4bc0d206-f6c4-44af-bc4d-f2856c2c825f req-931ad788-cde1-44bb-8cc6-f82c83af1ffe service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updated VIF entry in instance network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-4bc0d206-f6c4-44af-bc4d-f2856c2c825f req-931ad788-cde1-44bb-8cc6-f82c83af1ffe service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3aa165-2d76-432a-9e9b-5748b8d20ad7]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:04:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4bc0d206-f6c4-44af-bc4d-f2856c2c825f req-931ad788-cde1-44bb-8cc6-f82c83af1ffe service nova] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPiLNeGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23739626631666662', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739626631666662', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-994614910',display_name='tempest-TestShelveInstance-server-994614910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-994614910',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-535819981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9d5e24daa11c4757afc2c27aa246d31d',ramdisk_id='',reservation_id='r-tfo5a02l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1406034018',owner_user_name='tempest-TestShelveInstance-1406034018-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:04:02Z,user_data=None,user_id='c95f4f751dd443059465a9c3daa01f52',uuid=faa206d7-8728-4df2-be7d-cd0cb9e01bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converting VIF {"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.objects.instance [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lazy-loading 'pci_devices' on Instance uuid faa206d7-8728-4df2-be7d-cd0cb9e01bae {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.objects.base [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Object Instance<faa206d7-8728-4df2-be7d-cd0cb9e01bae> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:04:34 user nova-compute[74241]:   <uuid>faa206d7-8728-4df2-be7d-cd0cb9e01bae</uuid>
Oct 20 12:04:34 user nova-compute[74241]:   <name>instance-00000028</name>
Oct 20 12:04:34 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:04:34 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:04:34 user nova-compute[74241]:   <metadata>
Oct 20 12:04:34 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:04:34 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:04:34 user nova-compute[74241]:       <nova:name>tempest-TestShelveInstance-server-994614910</nova:name>
Oct 20 12:04:34 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:04:33</nova:creationTime>
Oct 20 12:04:34 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:04:34 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:04:34 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:04:34 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:04:34 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:04:34 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:04:34 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:04:34 user nova-compute[74241]:       <nova:owner>
Oct 20 12:04:34 user nova-compute[74241]:         <nova:user uuid="c95f4f751dd443059465a9c3daa01f52">tempest-TestShelveInstance-1406034018-project-member</nova:user>
Oct 20 12:04:34 user nova-compute[74241]:         <nova:project uuid="9d5e24daa11c4757afc2c27aa246d31d">tempest-TestShelveInstance-1406034018</nova:project>
Oct 20 12:04:34 user nova-compute[74241]:       </nova:owner>
Oct 20 12:04:34 user nova-compute[74241]:       <nova:ports>
Oct 20 12:04:34 user nova-compute[74241]:         <nova:port uuid="a53098e1-97f5-4c14-aeb6-7883ab442ca2">
Oct 20 12:04:34 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 12:04:34 user nova-compute[74241]:         </nova:port>
Oct 20 12:04:34 user nova-compute[74241]:       </nova:ports>
Oct 20 12:04:34 user nova-compute[74241]:     </nova:instance>
Oct 20 12:04:34 user nova-compute[74241]:   </metadata>
Oct 20 12:04:34 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:04:34 user nova-compute[74241]:     <system>
Oct 20 12:04:34 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:04:34 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:04:34 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:04:34 user nova-compute[74241]:       <entry name="serial">faa206d7-8728-4df2-be7d-cd0cb9e01bae</entry>
Oct 20 12:04:34 user nova-compute[74241]:       <entry name="uuid">faa206d7-8728-4df2-be7d-cd0cb9e01bae</entry>
Oct 20 12:04:34 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:04:34 user nova-compute[74241]:     </system>
Oct 20 12:04:34 user nova-compute[74241]:   </sysinfo>
Oct 20 12:04:34 user nova-compute[74241]:   <os>
Oct 20 12:04:34 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:04:34 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:04:34 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:04:34 user nova-compute[74241]:   </os>
Oct 20 12:04:34 user nova-compute[74241]:   <features>
Oct 20 12:04:34 user nova-compute[74241]:     <acpi/>
Oct 20 12:04:34 user nova-compute[74241]:     <apic/>
Oct 20 12:04:34 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:04:34 user nova-compute[74241]:   </features>
Oct 20 12:04:34 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:04:34 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:04:34 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:04:34 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:04:34 user nova-compute[74241]:   </clock>
Oct 20 12:04:34 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:04:34 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:04:34 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:04:34 user nova-compute[74241]:   </cpu>
Oct 20 12:04:34 user nova-compute[74241]:   <devices>
Oct 20 12:04:34 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:04:34 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:04:34 user nova-compute[74241]:       <source dev="/dev/sdc"/>
Oct 20 12:04:34 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:04:34 user nova-compute[74241]:       <serial>d404e218-9f3e-4b3f-a04e-ee52ed206b74</serial>
Oct 20 12:04:34 user nova-compute[74241]:     </disk>
Oct 20 12:04:34 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:04:34 user nova-compute[74241]:       <mac address="fa:16:3e:56:10:b1"/>
Oct 20 12:04:34 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:04:34 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:04:34 user nova-compute[74241]:       <target dev="tapa53098e1-97"/>
Oct 20 12:04:34 user nova-compute[74241]:     </interface>
Oct 20 12:04:34 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:04:34 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/faa206d7-8728-4df2-be7d-cd0cb9e01bae/console.log" append="off"/>
Oct 20 12:04:34 user nova-compute[74241]:     </serial>
Oct 20 12:04:34 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:04:34 user nova-compute[74241]:     <video>
Oct 20 12:04:34 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:04:34 user nova-compute[74241]:     </video>
Oct 20 12:04:34 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:04:34 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:04:34 user nova-compute[74241]:     </rng>
Oct 20 12:04:34 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:04:34 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:04:34 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:04:34 user nova-compute[74241]:     </memballoon>
Oct 20 12:04:34 user nova-compute[74241]:   </devices>
Oct 20 12:04:34 user nova-compute[74241]: </domain>
Oct 20 12:04:34 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-994614910',display_name='tempest-TestShelveInstance-server-994614910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-994614910',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-535819981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:00:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='9d5e24daa11c4757afc2c27aa246d31d',ramdisk_id='',reservation_id='r-tfo5a02l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1406034018',owner_user_name='tempest-TestShelveInstance-1406034018-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:04:02Z,user_data=None,user_id='c95f4f751dd443059465a9c3daa01f52',uuid=faa206d7-8728-4df2-be7d-cd0cb9e01bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converting VIF {"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG os_vif [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccb6c560-b8a0-56b2-bd47-4e0038b6c086', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa53098e1-97, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa53098e1-97, col_values=(('qos', UUID('ffb99bc7-a20b-47bc-b66b-4b52e805311f')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa53098e1-97, col_values=(('external_ids', {'iface-id': 'a53098e1-97f5-4c14-aeb6-7883ab442ca2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:10:b1', 'vm-uuid': 'faa206d7-8728-4df2-be7d-cd0cb9e01bae'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:34 user nova-compute[74241]: INFO os_vif [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97')
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:04:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] No VIF found with MAC fa:16:3e:56:10:b1, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:04:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-b1e570c4-b252-42f9-a934-1d795998e145 req-af2ddff6-e678-4deb-aa0f-77d0afb75362 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b1e570c4-b252-42f9-a934-1d795998e145 req-af2ddff6-e678-4deb-aa0f-77d0afb75362 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b1e570c4-b252-42f9-a934-1d795998e145 req-af2ddff6-e678-4deb-aa0f-77d0afb75362 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b1e570c4-b252-42f9-a934-1d795998e145 req-af2ddff6-e678-4deb-aa0f-77d0afb75362 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-b1e570c4-b252-42f9-a934-1d795998e145 req-af2ddff6-e678-4deb-aa0f-77d0afb75362 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:04:36 user nova-compute[74241]: WARNING nova.compute.manager [req-b1e570c4-b252-42f9-a934-1d795998e145 req-af2ddff6-e678-4deb-aa0f-77d0afb75362 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 12:04:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:04:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:04:37 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance spawned successfully.
Oct 20 12:04:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:04:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-186c6244-9dd7-4a16-8e6c-5b76e9e9638c tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 36.500s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-df8a2113-07cf-49aa-9238-4577ee86b714 req-9c938985-b147-482a-8414-da1da58a1024 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:04:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df8a2113-07cf-49aa-9238-4577ee86b714 req-9c938985-b147-482a-8414-da1da58a1024 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:04:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df8a2113-07cf-49aa-9238-4577ee86b714 req-9c938985-b147-482a-8414-da1da58a1024 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:04:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df8a2113-07cf-49aa-9238-4577ee86b714 req-9c938985-b147-482a-8414-da1da58a1024 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:04:38 user nova-compute[74241]: DEBUG nova.compute.manager [req-df8a2113-07cf-49aa-9238-4577ee86b714 req-9c938985-b147-482a-8414-da1da58a1024 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:04:38 user nova-compute[74241]: WARNING nova.compute.manager [req-df8a2113-07cf-49aa-9238-4577ee86b714 req-9c938985-b147-482a-8414-da1da58a1024 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state active and task_state None.
Oct 20 12:04:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:04:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:04:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:07 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:12 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:05:12 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:05:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:15 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:05:15 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=7853MB free_disk=24.863605499267578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 595814c8-bb69-474f-8d20-c765d6f03eab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 1803c43a-de8a-432b-a98e-2b3cdf72e514 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance faa206d7-8728-4df2-be7d-cd0cb9e01bae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:05:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:05:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-e50fada2-de91-453f-ac79-a4be7fd88b7b req-c139bbe5-049f-470d-a462-3e90f6fcf6a9 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received event network-changed-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-e50fada2-de91-453f-ac79-a4be7fd88b7b req-c139bbe5-049f-470d-a462-3e90f6fcf6a9 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Refreshing instance network info cache due to event network-changed-bf83966d-d350-4695-87e3-dc66f3c89efb. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:05:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e50fada2-de91-453f-ac79-a4be7fd88b7b req-c139bbe5-049f-470d-a462-3e90f6fcf6a9 service nova] Acquiring lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:05:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e50fada2-de91-453f-ac79-a4be7fd88b7b req-c139bbe5-049f-470d-a462-3e90f6fcf6a9 service nova] Acquired lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:05:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-e50fada2-de91-453f-ac79-a4be7fd88b7b req-c139bbe5-049f-470d-a462-3e90f6fcf6a9 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Refreshing network info cache for port bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:05:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-e50fada2-de91-453f-ac79-a4be7fd88b7b req-c139bbe5-049f-470d-a462-3e90f6fcf6a9 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Updated VIF entry in instance network info cache for port bf83966d-d350-4695-87e3-dc66f3c89efb. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:05:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-e50fada2-de91-453f-ac79-a4be7fd88b7b req-c139bbe5-049f-470d-a462-3e90f6fcf6a9 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Updating instance_info_cache with network_info: [{"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e50fada2-de91-453f-ac79-a4be7fd88b7b req-c139bbe5-049f-470d-a462-3e90f6fcf6a9 service nova] Releasing lock "refresh_cache-1803c43a-de8a-432b-a98e-2b3cdf72e514" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:05:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:05:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:05:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "3b63c384-23ec-404c-befd-c6792705d33b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3b63c384-23ec-404c-befd-c6792705d33b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:05:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:05:31 user nova-compute[74241]: INFO nova.compute.claims [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Claim successful on node user
Oct 20 12:05:32 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:05:32 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:05:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:05:32 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:05:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:05:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:05:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:05:32 user nova-compute[74241]: INFO nova.virt.block_device [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Booting with volume snapshot df6fe6ce-7723-4177-8088-e129cca72c43 at /dev/vda
Oct 20 12:05:32 user nova-compute[74241]: DEBUG nova.policy [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf5346976b7f45e1b146911555f458eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6744161987c43408e35c847ec2055a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Successfully created port: 242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-1a5aa105-6288-4988-aafa-77e88f43fbc3 req-271be2ad-8cc0-4b63-9c1d-759d1585ce16 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-changed-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-1a5aa105-6288-4988-aafa-77e88f43fbc3 req-271be2ad-8cc0-4b63-9c1d-759d1585ce16 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Refreshing instance network info cache due to event network-changed-b0bd4099-0208-462f-bf95-4fde5272d1ff. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1a5aa105-6288-4988-aafa-77e88f43fbc3 req-271be2ad-8cc0-4b63-9c1d-759d1585ce16 service nova] Acquiring lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1a5aa105-6288-4988-aafa-77e88f43fbc3 req-271be2ad-8cc0-4b63-9c1d-759d1585ce16 service nova] Acquired lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-1a5aa105-6288-4988-aafa-77e88f43fbc3 req-271be2ad-8cc0-4b63-9c1d-759d1585ce16 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Refreshing network info cache for port b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-1a5aa105-6288-4988-aafa-77e88f43fbc3 req-271be2ad-8cc0-4b63-9c1d-759d1585ce16 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updated VIF entry in instance network info cache for port b0bd4099-0208-462f-bf95-4fde5272d1ff. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-1a5aa105-6288-4988-aafa-77e88f43fbc3 req-271be2ad-8cc0-4b63-9c1d-759d1585ce16 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating instance_info_cache with network_info: [{"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1a5aa105-6288-4988-aafa-77e88f43fbc3 req-271be2ad-8cc0-4b63-9c1d-759d1585ce16 service nova] Releasing lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Successfully updated port: 242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquired lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-c4cdc55a-df81-4946-81c0-f92f8f13f6f6 req-ddbcceb5-bd3d-4f20-ba71-ab41322ab7ca service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received event network-changed-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-c4cdc55a-df81-4946-81c0-f92f8f13f6f6 req-ddbcceb5-bd3d-4f20-ba71-ab41322ab7ca service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Refreshing instance network info cache due to event network-changed-242a027b-a062-4afc-83ea-ae26aabeb85c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c4cdc55a-df81-4946-81c0-f92f8f13f6f6 req-ddbcceb5-bd3d-4f20-ba71-ab41322ab7ca service nova] Acquiring lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:05:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG nova.network.neutron [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Updating instance_info_cache with network_info: [{"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Releasing lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Instance network_info: |[{"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c4cdc55a-df81-4946-81c0-f92f8f13f6f6 req-ddbcceb5-bd3d-4f20-ba71-ab41322ab7ca service nova] Acquired lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG nova.network.neutron [req-c4cdc55a-df81-4946-81c0-f92f8f13f6f6 req-ddbcceb5-bd3d-4f20-ba71-ab41322ab7ca service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Refreshing network info cache for port 242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG nova.network.neutron [req-c4cdc55a-df81-4946-81c0-f92f8f13f6f6 req-ddbcceb5-bd3d-4f20-ba71-ab41322ab7ca service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Updated VIF entry in instance network info cache for port 242a027b-a062-4afc-83ea-ae26aabeb85c. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG nova.network.neutron [req-c4cdc55a-df81-4946-81c0-f92f8f13f6f6 req-ddbcceb5-bd3d-4f20-ba71-ab41322ab7ca service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Updating instance_info_cache with network_info: [{"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c4cdc55a-df81-4946-81c0-f92f8f13f6f6 req-ddbcceb5-bd3d-4f20-ba71-ab41322ab7ca service nova] Releasing lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:05:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:42 user nova-compute[74241]: INFO nova.compute.manager [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attaching volume 19162bcd-31db-4997-9445-070096376323 to /dev/vdb
Oct 20 12:05:42 user nova-compute[74241]: DEBUG os_brick.utils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aaefb1-4538-4c25-b842-ace3ae1ef906]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa05dcde-e398-425d-8190-07d4686167bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d7e58a-e4a1-4c7b-a34d-ceeae9b61d2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b7f60e-09f2-41d9-816b-2a42da92d948]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:05:42 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb3473-c4b9-4c4e-a971-1cf9a988c014]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG os_brick.utils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating existing volume attachment record: 808e414f-da93-4bda-b4c3-0b4f6cdcb892 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG os_brick.utils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc34251-0fd8-47b1-9d4d-7f8b4f6c8860]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd0a960-9d2f-4003-8421-8d63bbba3dfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dd58a4-04c7-46cb-ba54-19ee314066da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dbfed9-1c2e-4222-8a9d-0a1867cd99e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:05:43 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:05:43 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd555ca-d5d7-405b-a52d-50b795baa061]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG os_brick.utils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:05:43 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Updating existing volume attachment record: 5c201bdf-abef-443e-b0b1-bba8c6567862 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:05:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:48 user nova-compute[74241]: INFO nova.compute.manager [None req-8a0dd643-9843-4871-8c95-fa94545d1727 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Unrescuing
Oct 20 12:05:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8a0dd643-9843-4871-8c95-fa94545d1727 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:05:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8a0dd643-9843-4871-8c95-fa94545d1727 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquired lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:05:48 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8a0dd643-9843-4871-8c95-fa94545d1727 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8a0dd643-9843-4871-8c95-fa94545d1727 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updating instance_info_cache with network_info: [{"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8a0dd643-9843-4871-8c95-fa94545d1727 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Releasing lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG nova.objects.instance [None req-8a0dd643-9843-4871-8c95-fa94545d1727 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'flavor' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-343cc7fb-cef8-479d-9161-4bc6854d2d62 req-d61c2afd-5442-4271-91c4-e5748ed30217 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-343cc7fb-cef8-479d-9161-4bc6854d2d62 req-d61c2afd-5442-4271-91c4-e5748ed30217 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-343cc7fb-cef8-479d-9161-4bc6854d2d62 req-d61c2afd-5442-4271-91c4-e5748ed30217 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-343cc7fb-cef8-479d-9161-4bc6854d2d62 req-d61c2afd-5442-4271-91c4-e5748ed30217 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG nova.compute.manager [req-343cc7fb-cef8-479d-9161-4bc6854d2d62 req-d61c2afd-5442-4271-91c4-e5748ed30217 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:49 user nova-compute[74241]: WARNING nova.compute.manager [req-343cc7fb-cef8-479d-9161-4bc6854d2d62 req-d61c2afd-5442-4271-91c4-e5748ed30217 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state rescued and task_state unrescuing.
Oct 20 12:05:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:49 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance destroyed successfully.
Oct 20 12:05:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:51 user nova-compute[74241]: WARNING nova.compute.manager [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state rescued and task_state unrescuing.
Oct 20 12:05:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:51 user nova-compute[74241]: WARNING nova.compute.manager [req-e9a1683d-4bdf-42e0-8c57-32aebe8ffa6a req-8f15204a-4810-48f0-9f0b-e24599d9d514 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state rescued and task_state unrescuing.
Oct 20 12:05:52 user nova-compute[74241]: DEBUG nova.compute.manager [req-b1c9bece-e14b-4966-9e91-39e03710aa14 req-eae467bb-8a86-4399-b133-6b934e0e9c9b service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG nova.compute.manager [req-b1c9bece-e14b-4966-9e91-39e03710aa14 req-eae467bb-8a86-4399-b133-6b934e0e9c9b service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing instance network info cache due to event network-changed-a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b1c9bece-e14b-4966-9e91-39e03710aa14 req-eae467bb-8a86-4399-b133-6b934e0e9c9b service nova] Acquiring lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b1c9bece-e14b-4966-9e91-39e03710aa14 req-eae467bb-8a86-4399-b133-6b934e0e9c9b service nova] Acquired lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG nova.network.neutron [req-b1c9bece-e14b-4966-9e91-39e03710aa14 req-eae467bb-8a86-4399-b133-6b934e0e9c9b service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Refreshing network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:52 user nova-compute[74241]: INFO nova.compute.manager [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Terminating instance
Oct 20 12:05:52 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8a0dd643-9843-4871-8c95-fa94545d1727 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:53 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Instance destroyed successfully.
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lazy-loading 'resources' on Instance uuid faa206d7-8728-4df2-be7d-cd0cb9e01bae {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-994614910',display_name='tempest-TestShelveInstance-server-994614910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-994614910',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQBGA8EIm8bdVJEoVP1A+o2QsEnh5s5Fjh3QwSwGdgU1grqVHyJ15uJYdk5fN9/WKU3de/G6oP6K5TbfThBalLdsEvW+DkCwTCM5GBB4EeMKPhzV/HKHJ94FJdzFG2kSA==',key_name='tempest-TestShelveInstance-535819981',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:04:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d5e24daa11c4757afc2c27aa246d31d',ramdisk_id='',reservation_id='r-tfo5a02l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1406034018',owner_user_name='tempest-TestShelveInstance-1406034018-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:04:38Z,user_data=None,user_id='c95f4f751dd443059465a9c3daa01f52',uuid=faa206d7-8728-4df2-be7d-cd0cb9e01bae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converting VIF {"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_vif [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa53098e1-97, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffb99bc7-a20b-47bc-b66b-4b52e805311f) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:53 user nova-compute[74241]: INFO os_vif [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:10:b1,bridge_name='br-int',has_traffic_filtering=True,id=a53098e1-97f5-4c14-aeb6-7883ab442ca2,network=Network(1dce4e32-3b01-473e-8ae4-9240db1178be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53098e1-97')
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPiLNeGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:05:53 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec62945-f099-4d24-b613-3cb52540507b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:05:53 user nova-compute[74241]: No targets found.
Oct 20 12:05:53 user nova-compute[74241]: iSNS:
Oct 20 12:05:53 user nova-compute[74241]: No targets found.
Oct 20 12:05:53 user nova-compute[74241]: STATIC:
Oct 20 12:05:53 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86
Oct 20 12:05:53 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:05:53 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:05:53 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74
Oct 20 12:05:53 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:05:53 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:05:53 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:05:53 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:05:53 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:05:53 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb
Oct 20 12:05:53 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:05:53 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:05:53 user nova-compute[74241]: FIRMWARE:
Oct 20 12:05:53 user nova-compute[74241]: No targets found.
Oct 20 12:05:53 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:05:53 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:05:53 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d0f8d-faa7-46ce-9332-e69c5859062c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-cdb976a6-0943-4635-bbcf-c18053967e07 req-3f26343f-ea28-4f8b-9189-5a730bf09946 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cdb976a6-0943-4635-bbcf-c18053967e07 req-3f26343f-ea28-4f8b-9189-5a730bf09946 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cdb976a6-0943-4635-bbcf-c18053967e07 req-3f26343f-ea28-4f8b-9189-5a730bf09946 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cdb976a6-0943-4635-bbcf-c18053967e07 req-3f26343f-ea28-4f8b-9189-5a730bf09946 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-cdb976a6-0943-4635-bbcf-c18053967e07 req-3f26343f-ea28-4f8b-9189-5a730bf09946 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:53 user nova-compute[74241]: WARNING nova.compute.manager [req-cdb976a6-0943-4635-bbcf-c18053967e07 req-3f26343f-ea28-4f8b-9189-5a730bf09946 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state active and task_state None.
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b5a111-9061-4686-a581-027793a5e29e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:05:53 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:05:53 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:05:53 user nova-compute[74241]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:05:53 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:05:53 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:05:53 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:05:53 user nova-compute[74241]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 (non-flash)
Oct 20 12:05:53 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52283ba9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb73af2b-7848-48c4-b20e-baf8c78281c2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7def18-f41b-484c-b4a0-b08fc8ef7321]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[53307f5f-4bca-41b2-9352-e89e2f50ed30]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.network.neutron [req-b1c9bece-e14b-4966-9e91-39e03710aa14 req-eae467bb-8a86-4399-b133-6b934e0e9c9b service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updated VIF entry in instance network info cache for port a53098e1-97f5-4c14-aeb6-7883ab442ca2. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG nova.network.neutron [req-b1c9bece-e14b-4966-9e91-39e03710aa14 req-eae467bb-8a86-4399-b133-6b934e0e9c9b service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [{"id": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "address": "fa:16:3e:56:10:b1", "network": {"id": "1dce4e32-3b01-473e-8ae4-9240db1178be", "bridge": "br-int", "label": "tempest-TestShelveInstance-1450797932-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d5e24daa11c4757afc2c27aa246d31d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53098e1-97", "ovs_interfaceid": "a53098e1-97f5-4c14-aeb6-7883ab442ca2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b1c9bece-e14b-4966-9e91-39e03710aa14 req-eae467bb-8a86-4399-b133-6b934e0e9c9b service nova] Releasing lock "refresh_cache-faa206d7-8728-4df2-be7d-cd0cb9e01bae" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7694146-ff0e-4c73-ad9e-10786cfc22ca]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO40b1fdc0-79bf1ffba7c6ae40', '/dev/disk/by-id/scsi-23739626631666662', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_40b1fdc0') {{(pid=85185) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f463e0e9-a5ad-4034-836e-05838420f067]: (4, None) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b618b5-b7bf-4899-9274-7c02f1fefd58]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:05:53 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a84065c-767a-45af-a907-103b441cef6c]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260]
Oct 20 12:05:54 user nova-compute[74241]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74, portal: 172.16.0.220,3260] successful.
Oct 20 12:05:54 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d404e218-9f3e-4b3f-a04e-ee52ed206b74 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a90ca56-de3d-42f1-a24f-67f5584ab0f1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] <== disconnect_volume: return (437ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:05:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Deleting instance files /opt/stack/data/nova/instances/faa206d7-8728-4df2-be7d-cd0cb9e01bae_del
Oct 20 12:05:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Deletion of /opt/stack/data/nova/instances/faa206d7-8728-4df2-be7d-cd0cb9e01bae_del complete
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-e315db42-7034-4eb3-8378-7f432f46d2f5 req-5c7181e2-9c5c-43d6-814d-14de23bb3289 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received event network-changed-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-e315db42-7034-4eb3-8378-7f432f46d2f5 req-5c7181e2-9c5c-43d6-814d-14de23bb3289 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Refreshing instance network info cache due to event network-changed-d3a58115-3288-4a06-bd61-c751232bb9d1. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e315db42-7034-4eb3-8378-7f432f46d2f5 req-5c7181e2-9c5c-43d6-814d-14de23bb3289 service nova] Acquiring lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e315db42-7034-4eb3-8378-7f432f46d2f5 req-5c7181e2-9c5c-43d6-814d-14de23bb3289 service nova] Acquired lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.network.neutron [req-e315db42-7034-4eb3-8378-7f432f46d2f5 req-5c7181e2-9c5c-43d6-814d-14de23bb3289 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Refreshing network info cache for port d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:05:54 user nova-compute[74241]: INFO nova.compute.manager [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Took 1.43 seconds to destroy the instance on the hypervisor.
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.network.neutron [req-e315db42-7034-4eb3-8378-7f432f46d2f5 req-5c7181e2-9c5c-43d6-814d-14de23bb3289 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updated VIF entry in instance network info cache for port d3a58115-3288-4a06-bd61-c751232bb9d1. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.network.neutron [req-e315db42-7034-4eb3-8378-7f432f46d2f5 req-5c7181e2-9c5c-43d6-814d-14de23bb3289 service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updating instance_info_cache with network_info: [{"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e315db42-7034-4eb3-8378-7f432f46d2f5 req-5c7181e2-9c5c-43d6-814d-14de23bb3289 service nova] Releasing lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:54 user nova-compute[74241]: WARNING nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state active and task_state deleting.
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:54 user nova-compute[74241]: WARNING nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state active and task_state deleting.
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:54 user nova-compute[74241]: WARNING nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state active and task_state deleting.
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-unplugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Acquiring lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] No waiting events found dispatching network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:05:54 user nova-compute[74241]: WARNING nova.compute.manager [req-6cc19e80-042d-4815-9cdb-2cfce96a017e req-ec33294a-2e04-418b-97e7-fdd0be166526 service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received unexpected event network-vif-plugged-a53098e1-97f5-4c14-aeb6-7883ab442ca2 for instance with vm_state active and task_state deleting.
Oct 20 12:05:54 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:05:54 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Took 0.59 seconds to deallocate network for instance.
Oct 20 12:05:56 user nova-compute[74241]: DEBUG nova.compute.manager [req-e857396d-4d17-45ca-bf68-9479637d9488 req-8fec6828-fd83-4363-8e5e-4a61b75fad1b service nova] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Received event network-vif-deleted-a53098e1-97f5-4c14-aeb6-7883ab442ca2 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:05:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:05:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:08 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:06:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:06:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:16 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:06:16 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8092MB free_disk=24.862178802490234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 595814c8-bb69-474f-8d20-c765d6f03eab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 1803c43a-de8a-432b-a98e-2b3cdf72e514 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance faa206d7-8728-4df2-be7d-cd0cb9e01bae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b63c384-23ec-404c-befd-c6792705d33b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:06:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:06:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:06:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:06:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updating instance_info_cache with network_info: [{"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:18 user nova-compute[74241]: INFO nova.compute.manager [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Took 23.79 seconds to detach 1 volumes for instance.
Oct 20 12:06:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] [instance: faa206d7-8728-4df2-be7d-cd0cb9e01bae] Deleting volume: d404e218-9f3e-4b3f-a04e-ee52ed206b74 {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaIEuxfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:06:18 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:06:18 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:06:18 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcce8d3-69a1-40d4-aa86-6320385d7ab7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:06:18 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae7f6d0-1183-4fea-937f-6c1f16937e55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323] added
Oct 20 12:06:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88a8042-819a-4f9a-8f22-83da13e688cc]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4feaed2-74a8-441f-83c1-ec98cc570af8]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaIEuxfw {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaIEuxfw" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb841a3d-f4fc-4960-891e-11074c6ff1e1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaIEuxfw'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG nova.objects.instance [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'flavor' on Instance uuid fc3d7431-755e-4fb5-8c3a-21d5feee64fc {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ce17a8-07e1-45fa-bd68-6613eb1e7d26]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[def3471b-ad33-4e2a-a282-742796498da8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:06:19 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Creating image(s)
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Ensure instance console log exists: /opt/stack/data/nova/instances/3b63c384-23ec-404c-befd-c6792705d33b/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Start _get_guest_xml network_info=[{"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T12:05:20Z,direct_url=<?>,disk_format='qcow2',id=0d21445b-fdc2-4599-b281-c2531d8274e3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-47726780',owner='e6744161987c43408e35c847ec2055a5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T12:05:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '5c201bdf-abef-443e-b0b1-bba8c6567862', 'delete_on_termination': True, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFLCXxuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b63c384-23ec-404c-befd-c6792705d33b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce0fd4ab-aa6f-4146-a9c6-dee0cef79767', 'serial': 'ce0fd4ab-aa6f-4146-a9c6-dee0cef79767'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a5dd8d-8d2f-40e6-b0eb-8f23303d2837]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323, portal: 172.16.0.220,3260]
Oct 20 12:06:19 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323, portal: 172.16.0.220,3260] successful.
Oct 20 12:06:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:06:19 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T12:05:20Z,direct_url=<?>,disk_format='qcow2',id=0d21445b-fdc2-4599-b281-c2531d8274e3,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-47726780',owner='e6744161987c43408e35c847ec2055a5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T12:05:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFLCXxuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:06:19 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[135a753b-a556-41ba-83e8-e269218513d5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:19 user nova-compute[74241]: INFO nova.compute.manager [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Attaching volume a0593207-1c59-4e9b-a96b-4a6aacb6df39 to /dev/vdb
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[df981920-473f-421d-b53d-07b6ca086bd6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:19 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa64d4aa-8bb7-4970-92d3-e14b66eaa096]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaIEuxfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.utils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[366018d3-4404-4e21-8608-ddf846af0361]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fbb23c-4c4a-4177-bda3-74571025f6ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6a6c9d-52de-4c0e-a043-03a3eb649f44]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a2361b-b3a1-43aa-aedc-edef2ec94af6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Deleted allocations for instance faa206d7-8728-4df2-be7d-cd0cb9e01bae
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:06:19 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1b1c9-ac42-4f13-9ff7-016a1a2d87ae]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG os_brick.utils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updating existing volume attachment record: 0f79c2bd-fdec-4e33-a340-6fe5efed5b66 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:06:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7967a2bc-dc92-4737-992d-e3043c47d341 tempest-TestShelveInstance-1406034018 tempest-TestShelveInstance-1406034018-project-member] Lock "faa206d7-8728-4df2-be7d-cd0cb9e01bae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 26.672s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23336303866323130', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336303866323130', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.094s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:06:20 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:06:20 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0649897b-32d6-4451-a953-c063032ffcb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:06:20 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 12:06:20 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:06:20 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:06:20 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:06:20 user nova-compute[74241]:   <serial>19162bcd-31db-4997-9445-070096376323</serial>
Oct 20 12:06:20 user nova-compute[74241]: </disk>
Oct 20 12:06:20 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f43a0e-f124-464c-a002-4cbe9020a5bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767] added
Oct 20 12:06:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2240e4c-d5d1-4929-9e10-88b9b308532d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f69ec3d-1e71-4620-b438-cc48ba911ba6]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFLCXxuK {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFLCXxuK" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd4e4f2-0ac6-466b-a521-5048875bc180]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFLCXxuK'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbabc893-2abf-457f-a5fe-0a07bec4b50e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[359a6e9c-8c35-42e2-b997-f2bda907c99c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[27555641-d404-4c46-9565-ed94867b686e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767, portal: 172.16.0.220,3260]
Oct 20 12:06:20 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767, portal: 172.16.0.220,3260] successful.
Oct 20 12:06:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f31f9-2f61-4d3a-997a-660456722177]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[af14573f-f4a0-4a80-a132-d05c3055a98e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:06:20 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eac522e-e41e-4472-981d-b3f888fa7a2a]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No VIF found with MAC fa:16:3e:61:a2:5a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:06:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7d53d217-6c65-403c-88cd-038b41882a1a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.444s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFLCXxuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== connect_volume: return (2418ms) {'type': 'block', 'scsi_wwn': '26333323834343139', 'path': '/dev/sdf'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333323834343139', 'path': '/dev/sdf'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-991360223',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-991360223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-991360223',id=46,image_ref='0d21445b-fdc2-4599-b281-c2531d8274e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgV4zOicXLTGehwSJkQ+Uh5u2JnMVR2DKZtwFRuQ2gqWJnu6O7Jp5SVWZLUGshbCwYmp53w6/ikT3SOrE9wToMEfP6OetCJUuQvQDFHVNU4yq85VsBYVMArc6LjaEwIPA==',key_name='tempest-keypair-1892085390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-z9kyz6d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-71867186',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf5346976b7f45e1b146911555f458eb',uuid=3b63c384-23ec-404c-befd-c6792705d33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:dc:48,bridge_name='br-int',has_traffic_filtering=True,id=242a027b-a062-4afc-83ea-ae26aabeb85c,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242a027b-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.objects.instance [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b63c384-23ec-404c-befd-c6792705d33b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:06:21 user nova-compute[74241]:   <uuid>3b63c384-23ec-404c-befd-c6792705d33b</uuid>
Oct 20 12:06:21 user nova-compute[74241]:   <name>instance-0000002e</name>
Oct 20 12:06:21 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:06:21 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:06:21 user nova-compute[74241]:   <metadata>
Oct 20 12:06:21 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:06:21 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:06:21 user nova-compute[74241]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-991360223</nova:name>
Oct 20 12:06:21 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:06:19</nova:creationTime>
Oct 20 12:06:21 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:06:21 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:06:21 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:06:21 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:06:21 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:06:21 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:06:21 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:06:21 user nova-compute[74241]:       <nova:owner>
Oct 20 12:06:21 user nova-compute[74241]:         <nova:user uuid="bf5346976b7f45e1b146911555f458eb">tempest-TestVolumeBootPattern-71867186-project-member</nova:user>
Oct 20 12:06:21 user nova-compute[74241]:         <nova:project uuid="e6744161987c43408e35c847ec2055a5">tempest-TestVolumeBootPattern-71867186</nova:project>
Oct 20 12:06:21 user nova-compute[74241]:       </nova:owner>
Oct 20 12:06:21 user nova-compute[74241]:       <nova:root type="image" uuid="0d21445b-fdc2-4599-b281-c2531d8274e3"/>
Oct 20 12:06:21 user nova-compute[74241]:       <nova:ports>
Oct 20 12:06:21 user nova-compute[74241]:         <nova:port uuid="242a027b-a062-4afc-83ea-ae26aabeb85c">
Oct 20 12:06:21 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 12:06:21 user nova-compute[74241]:         </nova:port>
Oct 20 12:06:21 user nova-compute[74241]:       </nova:ports>
Oct 20 12:06:21 user nova-compute[74241]:     </nova:instance>
Oct 20 12:06:21 user nova-compute[74241]:   </metadata>
Oct 20 12:06:21 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:06:21 user nova-compute[74241]:     <system>
Oct 20 12:06:21 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:06:21 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:06:21 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:06:21 user nova-compute[74241]:       <entry name="serial">3b63c384-23ec-404c-befd-c6792705d33b</entry>
Oct 20 12:06:21 user nova-compute[74241]:       <entry name="uuid">3b63c384-23ec-404c-befd-c6792705d33b</entry>
Oct 20 12:06:21 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:06:21 user nova-compute[74241]:     </system>
Oct 20 12:06:21 user nova-compute[74241]:   </sysinfo>
Oct 20 12:06:21 user nova-compute[74241]:   <os>
Oct 20 12:06:21 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:06:21 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:06:21 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:06:21 user nova-compute[74241]:   </os>
Oct 20 12:06:21 user nova-compute[74241]:   <features>
Oct 20 12:06:21 user nova-compute[74241]:     <acpi/>
Oct 20 12:06:21 user nova-compute[74241]:     <apic/>
Oct 20 12:06:21 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:06:21 user nova-compute[74241]:   </features>
Oct 20 12:06:21 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:06:21 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:06:21 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:06:21 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:06:21 user nova-compute[74241]:   </clock>
Oct 20 12:06:21 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:06:21 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:06:21 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:06:21 user nova-compute[74241]:   </cpu>
Oct 20 12:06:21 user nova-compute[74241]:   <devices>
Oct 20 12:06:21 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:06:21 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:06:21 user nova-compute[74241]:       <source dev="/dev/sdf"/>
Oct 20 12:06:21 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:06:21 user nova-compute[74241]:       <serial>ce0fd4ab-aa6f-4146-a9c6-dee0cef79767</serial>
Oct 20 12:06:21 user nova-compute[74241]:     </disk>
Oct 20 12:06:21 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:06:21 user nova-compute[74241]:       <mac address="fa:16:3e:d3:dc:48"/>
Oct 20 12:06:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:06:21 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:06:21 user nova-compute[74241]:       <target dev="tap242a027b-a0"/>
Oct 20 12:06:21 user nova-compute[74241]:     </interface>
Oct 20 12:06:21 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:06:21 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/3b63c384-23ec-404c-befd-c6792705d33b/console.log" append="off"/>
Oct 20 12:06:21 user nova-compute[74241]:     </serial>
Oct 20 12:06:21 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:06:21 user nova-compute[74241]:     <video>
Oct 20 12:06:21 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:06:21 user nova-compute[74241]:     </video>
Oct 20 12:06:21 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:06:21 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:06:21 user nova-compute[74241]:     </rng>
Oct 20 12:06:21 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:06:21 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:06:21 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:06:21 user nova-compute[74241]:     </memballoon>
Oct 20 12:06:21 user nova-compute[74241]:   </devices>
Oct 20 12:06:21 user nova-compute[74241]: </domain>
Oct 20 12:06:21 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-991360223',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-991360223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-991360223',id=46,image_ref='0d21445b-fdc2-4599-b281-c2531d8274e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgV4zOicXLTGehwSJkQ+Uh5u2JnMVR2DKZtwFRuQ2gqWJnu6O7Jp5SVWZLUGshbCwYmp53w6/ikT3SOrE9wToMEfP6OetCJUuQvQDFHVNU4yq85VsBYVMArc6LjaEwIPA==',key_name='tempest-keypair-1892085390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-z9kyz6d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-71867186',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:05:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf5346976b7f45e1b146911555f458eb',uuid=3b63c384-23ec-404c-befd-c6792705d33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:dc:48,bridge_name='br-int',has_traffic_filtering=True,id=242a027b-a062-4afc-83ea-ae26aabeb85c,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242a027b-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG os_vif [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:dc:48,bridge_name='br-int',has_traffic_filtering=True,id=242a027b-a062-4afc-83ea-ae26aabeb85c,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242a027b-a0') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd52f4c09-fe45-59eb-95b9-3f50d6429e27', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap242a027b-a0, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap242a027b-a0, col_values=(('qos', UUID('34a5bf75-c339-4060-9091-d8801ed59f28')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap242a027b-a0, col_values=(('external_ids', {'iface-id': '242a027b-a062-4afc-83ea-ae26aabeb85c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:dc:48', 'vm-uuid': '3b63c384-23ec-404c-befd-c6792705d33b'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:21 user nova-compute[74241]: INFO os_vif [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:dc:48,bridge_name='br-int',has_traffic_filtering=True,id=242a027b-a062-4afc-83ea-ae26aabeb85c,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242a027b-a0')
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:06:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No VIF found with MAC fa:16:3e:d3:dc:48, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-8fc3f160-f005-4a21-a886-2bfc1363d350 req-be44d5ee-db63-442e-8aa2-8af6ffee30fc service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received event network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8fc3f160-f005-4a21-a886-2bfc1363d350 req-be44d5ee-db63-442e-8aa2-8af6ffee30fc service nova] Acquiring lock "3b63c384-23ec-404c-befd-c6792705d33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8fc3f160-f005-4a21-a886-2bfc1363d350 req-be44d5ee-db63-442e-8aa2-8af6ffee30fc service nova] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8fc3f160-f005-4a21-a886-2bfc1363d350 req-be44d5ee-db63-442e-8aa2-8af6ffee30fc service nova] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-8fc3f160-f005-4a21-a886-2bfc1363d350 req-be44d5ee-db63-442e-8aa2-8af6ffee30fc service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] No waiting events found dispatching network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:06:23 user nova-compute[74241]: WARNING nova.compute.manager [req-8fc3f160-f005-4a21-a886-2bfc1363d350 req-be44d5ee-db63-442e-8aa2-8af6ffee30fc service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received unexpected event network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c for instance with vm_state building and task_state spawning.
Oct 20 12:06:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:06:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:06:25 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Instance spawned successfully.
Oct 20 12:06:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:06:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:06:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:06:25 user nova-compute[74241]: INFO nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 20 12:06:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:06:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-c38224a4-2901-4b48-9e14-7b9cf94598b6 req-66fef633-761c-466d-8df1-56cc0df1546b service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received event network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:06:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c38224a4-2901-4b48-9e14-7b9cf94598b6 req-66fef633-761c-466d-8df1-56cc0df1546b service nova] Acquiring lock "3b63c384-23ec-404c-befd-c6792705d33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c38224a4-2901-4b48-9e14-7b9cf94598b6 req-66fef633-761c-466d-8df1-56cc0df1546b service nova] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c38224a4-2901-4b48-9e14-7b9cf94598b6 req-66fef633-761c-466d-8df1-56cc0df1546b service nova] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-c38224a4-2901-4b48-9e14-7b9cf94598b6 req-66fef633-761c-466d-8df1-56cc0df1546b service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] No waiting events found dispatching network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:06:25 user nova-compute[74241]: WARNING nova.compute.manager [req-c38224a4-2901-4b48-9e14-7b9cf94598b6 req-66fef633-761c-466d-8df1-56cc0df1546b service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received unexpected event network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c for instance with vm_state building and task_state spawning.
Oct 20 12:06:25 user nova-compute[74241]: INFO nova.compute.manager [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Took 53.96 seconds to build instance.
Oct 20 12:06:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-12ac3096-2912-47b8-9e4e-620e0595ca42 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3b63c384-23ec-404c-befd-c6792705d33b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 54.055s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:06:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:06:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKwSCVtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:06:45 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:06:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:06:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:06:45 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:06:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:06:45 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:06:45 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:06:45 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95b190b-29a9-419b-9bb2-c9f0a811ee49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:06:46 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20979c4-2cdc-4fb3-9ec8-10416ca55c26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39] added
Oct 20 12:06:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf0e3a4-530f-45a7-9cc8-46ee23eea67d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f73d127-eb70-4db0-abff-86f6e764ba36]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKwSCVtT {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dKwSCVtT" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0e2e73-60b0-4e89-b97c-96bcf62ae825]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dKwSCVtT'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c803137d-74b5-446a-8b85-2df45a505199]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d87344-776b-4454-94e5-dab76e820a80]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c15d1c-8feb-498a-99a7-1b16f1eed070]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39, portal: 172.16.0.220,3260]
Oct 20 12:06:46 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39, portal: 172.16.0.220,3260] successful.
Oct 20 12:06:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0065b22-9f05-49a8-bd03-b7a63791e921]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[77822c16-6e9a-4c1e-8cf1-c57b9112bc46]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 (non-flash)
Oct 20 12:06:46 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] HCTL ('38', '-', '-', 0) found on session 51 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8d62a5-61b8-42fa-a3a7-b9408c9a9651]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Searching for a device in session 51 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKwSCVtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:06:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23936616163363665', 'path': '/dev/sdg'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936616163363665', 'path': '/dev/sdg'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG nova.objects.instance [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'flavor' on Instance uuid fc3d7431-755e-4fb5-8c3a-21d5feee64fc {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 12:06:47 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:06:47 user nova-compute[74241]:   <source dev="/dev/sdg"/>
Oct 20 12:06:47 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:06:47 user nova-compute[74241]:   <serial>a0593207-1c59-4e9b-a96b-4a6aacb6df39</serial>
Oct 20 12:06:47 user nova-compute[74241]: </disk>
Oct 20 12:06:47 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] No VIF found with MAC fa:16:3e:99:34:8b, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:06:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-eaadcb52-42d0-48b6-b6e9-3d6156f87143 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.820s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:06:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:49 user nova-compute[74241]: INFO nova.compute.manager [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Detaching volume a0593207-1c59-4e9b-a96b-4a6aacb6df39
Oct 20 12:06:49 user nova-compute[74241]: INFO nova.virt.block_device [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Attempting to driver detach volume a0593207-1c59-4e9b-a96b-4a6aacb6df39 from mountpoint /dev/vdb
Oct 20 12:06:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Attempting to detach device vdb from instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:06:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:06:49 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:06:49 user nova-compute[74241]:   <source dev="/dev/sdg"/>
Oct 20 12:06:49 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:06:49 user nova-compute[74241]:   <serial>a0593207-1c59-4e9b-a96b-4a6aacb6df39</serial>
Oct 20 12:06:49 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:06:49 user nova-compute[74241]: </disk>
Oct 20 12:06:49 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:06:49 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Successfully detached device vdb from instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc from the persistent domain config.
Oct 20 12:06:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:06:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:06:49 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:06:49 user nova-compute[74241]:   <source dev="/dev/sdg"/>
Oct 20 12:06:49 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:06:49 user nova-compute[74241]:   <serial>a0593207-1c59-4e9b-a96b-4a6aacb6df39</serial>
Oct 20 12:06:49 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:06:49 user nova-compute[74241]: </disk>
Oct 20 12:06:49 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:06:50 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:06:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:06:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:06:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:06:54 user nova-compute[74241]: INFO nova.compute.manager [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Detaching volume 19162bcd-31db-4997-9445-070096376323
Oct 20 12:06:54 user nova-compute[74241]: INFO nova.virt.block_device [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attempting to driver detach volume 19162bcd-31db-4997-9445-070096376323 from mountpoint /dev/vdb
Oct 20 12:06:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Attempting to detach device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:06:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:06:54 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:06:54 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:06:54 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:06:54 user nova-compute[74241]:   <serial>19162bcd-31db-4997-9445-070096376323</serial>
Oct 20 12:06:54 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:06:54 user nova-compute[74241]: </disk>
Oct 20 12:06:54 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:06:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully detached device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the persistent domain config.
Oct 20 12:06:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:06:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:06:54 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:06:54 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:06:54 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:06:54 user nova-compute[74241]:   <serial>19162bcd-31db-4997-9445-070096376323</serial>
Oct 20 12:06:54 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:06:54 user nova-compute[74241]: </disk>
Oct 20 12:06:54 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:06:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:06:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:10 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc is timed out.
Oct 20 12:07:10 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Successfully detached device vdb from instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc from the live domain config.
Oct 20 12:07:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dKwSCVtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:07:10 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f689829c-bc8a-4054-954d-0129f9cc63f5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:07:10 user nova-compute[74241]: No targets found.
Oct 20 12:07:10 user nova-compute[74241]: iSNS:
Oct 20 12:07:10 user nova-compute[74241]: No targets found.
Oct 20 12:07:10 user nova-compute[74241]: STATIC:
Oct 20 12:07:10 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86
Oct 20 12:07:10 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:10 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:10 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323
Oct 20 12:07:10 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:10 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:10 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:07:10 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:10 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:10 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb
Oct 20 12:07:10 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:10 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:10 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39
Oct 20 12:07:10 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:10 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:10 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767
Oct 20 12:07:10 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:10 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:10 user nova-compute[74241]: FIRMWARE:
Oct 20 12:07:10 user nova-compute[74241]: No targets found.
Oct 20 12:07:10 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:07:10 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:07:10 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1568a364-7663-4974-8902-2386b41c39b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b645521-d9fb-4b3b-ac71-df8c5e52a28f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 (non-flash)
Oct 20 12:07:10 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5240177eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39'): ({'sdg'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Removing single pathed devices sdg {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85a98df-ebf4-4f92-bf3d-f1b1ccaa0668]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcd8e4a-4ea1-4256-b6e5-472d2ef92543]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Flushing IO for device /dev/sdg {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89eb110-7f2b-4161-99fd-7d41f7535cf9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b14b5c-62f2-4fcc-bf6a-abedfe009838]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] SCSI volumes sdg have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4928bfc-c190-49ee-8d11-a45f9f8f9112]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[45989ab0-7b27-4255-a39d-992b11be2900]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39, portal: 172.16.0.220,3260]
Oct 20 12:07:10 user nova-compute[74241]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39, portal: 172.16.0.220,3260] successful.
Oct 20 12:07:10 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0593207-1c59-4e9b-a96b-4a6aacb6df39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50fbb31-2e2f-4de1-bbda-a192bc1a3885]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] <== disconnect_volume: return (325ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:07:10 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:07:11 user nova-compute[74241]: DEBUG nova.objects.instance [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'flavor' on Instance uuid fc3d7431-755e-4fb5-8c3a-21d5feee64fc {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:07:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8535f305-bcd9-415a-af50-d7610cec0ae0 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.962s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:07:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:07:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:07:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:07:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:07:13 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:13 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:13 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:07:13 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:07:13 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 is timed out.
Oct 20 12:07:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully detached device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the live domain config.
Oct 20 12:07:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaIEuxfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:07:14 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5966a251-7e6d-4986-a7f1-88414e481706]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:07:14 user nova-compute[74241]: No targets found.
Oct 20 12:07:14 user nova-compute[74241]: iSNS:
Oct 20 12:07:14 user nova-compute[74241]: No targets found.
Oct 20 12:07:14 user nova-compute[74241]: STATIC:
Oct 20 12:07:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86
Oct 20 12:07:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323
Oct 20 12:07:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:07:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb
Oct 20 12:07:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767
Oct 20 12:07:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:14 user nova-compute[74241]: FIRMWARE:
Oct 20 12:07:14 user nova-compute[74241]: No targets found.
Oct 20 12:07:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:07:14 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:07:14 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e11f80-2c53-41eb-a8e9-8815ac523549]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[400d2e34-4085-4e12-afdc-3e2fca0f3bfa]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:07:14 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:07:14 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:07:14 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:07:14 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:07:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:07:14 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:07:14 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:07:14 user nova-compute[74241]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 (non-flash)
Oct 20 12:07:14 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:07:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5208546d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:07:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3b751-f498-49be-a8f6-a15a780e3928]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef58f44-d6fd-4f92-94fe-06d2de7f4062]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54a5a24-2277-4bbb-a965-2cbfa27d6c3e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d95ed-1b5b-4e59-9147-fba910aa486b]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d884df5-471d-4f83-ada6-5bfd19a9871a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1b37fa-2576-4da7-b66b-9a78c9b1e042]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323, portal: 172.16.0.220,3260]
Oct 20 12:07:15 user nova-compute[74241]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323, portal: 172.16.0.220,3260] successful.
Oct 20 12:07:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19162bcd-31db-4997-9445-070096376323 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ade6d0-03eb-436c-8be6-f6bc06b95f43]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== disconnect_volume: return (352ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.objects.instance [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:07:16 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:07:16 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8016MB free_disk=24.85071563720703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-7dd05424-bcd7-4231-a759-bf71d861e9dc tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 595814c8-bb69-474f-8d20-c765d6f03eab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 1803c43a-de8a-432b-a98e-2b3cdf72e514 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3b63c384-23ec-404c-befd-c6792705d33b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:07:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:07:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:07:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:07:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:07:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updating instance_info_cache with network_info: [{"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:07:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-595814c8-bb69-474f-8d20-c765d6f03eab" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:07:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:07:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:07:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:20 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:07:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:07:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "595814c8-bb69-474f-8d20-c765d6f03eab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:39 user nova-compute[74241]: INFO nova.compute.manager [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Terminating instance
Oct 20 12:07:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:07:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-25fea3ad-5d9a-4f0f-bf6b-84e27c59a100 req-dd514579-f00b-4a27-b929-292e5ae5ee06 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-25fea3ad-5d9a-4f0f-bf6b-84e27c59a100 req-dd514579-f00b-4a27-b929-292e5ae5ee06 service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-25fea3ad-5d9a-4f0f-bf6b-84e27c59a100 req-dd514579-f00b-4a27-b929-292e5ae5ee06 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-25fea3ad-5d9a-4f0f-bf6b-84e27c59a100 req-dd514579-f00b-4a27-b929-292e5ae5ee06 service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-25fea3ad-5d9a-4f0f-bf6b-84e27c59a100 req-dd514579-f00b-4a27-b929-292e5ae5ee06 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-25fea3ad-5d9a-4f0f-bf6b-84e27c59a100 req-dd514579-f00b-4a27-b929-292e5ae5ee06 service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-unplugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:07:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Instance destroyed successfully.
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.objects.instance [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'resources' on Instance uuid 595814c8-bb69-474f-8d20-c765d6f03eab {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:01:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2111188889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2111188889',id=42,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:04:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-1qfjrz5x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:05:53Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=595814c8-bb69-474f-8d20-c765d6f03eab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "address": "fa:16:3e:95:16:68", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eaf149b-3d", "ovs_interfaceid": "9eaf149b-3d41-4c5f-ae86-015b6b0202cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:16:68,bridge_name='br-int',has_traffic_filtering=True,id=9eaf149b-3d41-4c5f-ae86-015b6b0202cd,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eaf149b-3d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_vif [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:16:68,bridge_name='br-int',has_traffic_filtering=True,id=9eaf149b-3d41-4c5f-ae86-015b6b0202cd,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eaf149b-3d') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9eaf149b-3d, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=690508c8-3b70-4b71-b1b6-f2ecb68a9520) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: INFO os_vif [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:16:68,bridge_name='br-int',has_traffic_filtering=True,id=9eaf149b-3d41-4c5f-ae86-015b6b0202cd,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eaf149b-3d')
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EPrnWgUm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:07:40 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[006c21c0-4180-4ff8-8c11-e80b98e81350]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:07:40 user nova-compute[74241]: No targets found.
Oct 20 12:07:40 user nova-compute[74241]: iSNS:
Oct 20 12:07:40 user nova-compute[74241]: No targets found.
Oct 20 12:07:40 user nova-compute[74241]: STATIC:
Oct 20 12:07:40 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86
Oct 20 12:07:40 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:40 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:40 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:07:40 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:40 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:40 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb
Oct 20 12:07:40 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:40 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:40 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767
Oct 20 12:07:40 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:07:40 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:07:40 user nova-compute[74241]: FIRMWARE:
Oct 20 12:07:40 user nova-compute[74241]: No targets found.
Oct 20 12:07:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:07:40 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:07:40 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-225b10f5-a364-4220-a1a0-442f00ca06fa req-d1fb403b-ec52-46f9-947f-841bb0f9790f service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received event network-changed-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.compute.manager [req-225b10f5-a364-4220-a1a0-442f00ca06fa req-d1fb403b-ec52-46f9-947f-841bb0f9790f service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Refreshing instance network info cache due to event network-changed-d3a58115-3288-4a06-bd61-c751232bb9d1. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-225b10f5-a364-4220-a1a0-442f00ca06fa req-d1fb403b-ec52-46f9-947f-841bb0f9790f service nova] Acquiring lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-225b10f5-a364-4220-a1a0-442f00ca06fa req-d1fb403b-ec52-46f9-947f-841bb0f9790f service nova] Acquired lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.network.neutron [req-225b10f5-a364-4220-a1a0-442f00ca06fa req-d1fb403b-ec52-46f9-947f-841bb0f9790f service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Refreshing network info cache for port d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec946cb3-d5ba-4c74-b8cd-3729ee447462]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e6afc-f3b4-4b4a-bd09-164ef34a3e7f]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:07:40 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:07:40 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:07:40 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:07:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:07:40 user nova-compute[74241]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb (non-flash)
Oct 20 12:07:40 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:07:40 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:07:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52283740d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb'): ({'sde'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Removing single pathed devices sde {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[672fd9c7-7ac7-49b9-b409-ce76a470e9df]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8892d4c4-7aad-44d4-b61b-58bf374186d1]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flushing IO for device /dev/sde {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[385cfabe-7836-4e6e-a632-d07a50e7af96]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:07:40 user nova-compute[74241]: INFO nova.compute.manager [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Terminating instance
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb7964b-58eb-45fd-a7d9-e6a6e36d2962]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] SCSI volumes sde have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3519d847-2c2f-4eb7-b58c-aa71a837918b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6442d4d-a29f-4c9f-ab03-25154cfd09bc]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb, portal: 172.16.0.220,3260]
Oct 20 12:07:40 user nova-compute[74241]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb, portal: 172.16.0.220,3260] successful.
Oct 20 12:07:40 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:312aed4d-80f1-4986-b638-086851269efb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51335b8-c894-4df5-9daa-38367ed51db7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] <== disconnect_volume: return (391ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:07:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Deleting instance files /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab_del
Oct 20 12:07:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Deletion of /opt/stack/data/nova/instances/595814c8-bb69-474f-8d20-c765d6f03eab_del complete
Oct 20 12:07:40 user nova-compute[74241]: INFO nova.compute.manager [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Took 1.28 seconds to destroy the instance on the hypervisor.
Oct 20 12:07:40 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:07:40 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-225b10f5-a364-4220-a1a0-442f00ca06fa req-d1fb403b-ec52-46f9-947f-841bb0f9790f service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updated VIF entry in instance network info cache for port d3a58115-3288-4a06-bd61-c751232bb9d1. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.network.neutron [req-225b10f5-a364-4220-a1a0-442f00ca06fa req-d1fb403b-ec52-46f9-947f-841bb0f9790f service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updating instance_info_cache with network_info: [{"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-225b10f5-a364-4220-a1a0-442f00ca06fa req-d1fb403b-ec52-46f9-947f-841bb0f9790f service nova] Releasing lock "refresh_cache-fc3d7431-755e-4fb5-8c3a-21d5feee64fc" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:07:41 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Instance destroyed successfully.
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.objects.instance [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'resources' on Instance uuid fc3d7431-755e-4fb5-8c3a-21d5feee64fc {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:04:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1017554264',display_name='tempest-TestStampPattern-server-1017554264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1017554264',id=45,image_ref='1958aba5-1350-4ab1-920b-7ed9cb13578d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKjNjBfodxRSr5YvavNS/uQaM3H/sSuwdLpiLie0Gc+zlYN3eiXZGDk/CPuRUr1nTvtuenQYt1ietTjwkbxk07PqaQmzMx7LgbHmAAcY8qdVSzmBI9C6xbIafIRctDz+Q==',key_name='tempest-TestStampPattern-37297663',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:04:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12c1d28fe5a7414ca1aa84dbd092eb26',ramdisk_id='',reservation_id='r-adyj0ahi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8c3d85a7-f4a9-4998-be6a-d50078f02658',image_min_disk='1',image_min_ram='0',image_owner_id='12c1d28fe5a7414ca1aa84dbd092eb26',image_owner_project_name='tempest-TestStampPattern-372523597',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-372523597-project-member',image_user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',owner_project_name='tempest-TestStampPattern-372523597',owner_user_name='tempest-TestStampPattern-372523597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:04:10Z,user_data=None,user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',uuid=fc3d7431-755e-4fb5-8c3a-21d5feee64fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converting VIF {"id": "d3a58115-3288-4a06-bd61-c751232bb9d1", "address": "fa:16:3e:99:34:8b", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3a58115-32", "ovs_interfaceid": "d3a58115-3288-4a06-bd61-c751232bb9d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:34:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3a58115-3288-4a06-bd61-c751232bb9d1,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a58115-32') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG os_vif [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:34:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3a58115-3288-4a06-bd61-c751232bb9d1,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a58115-32') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3a58115-32, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55f9c9b0-68bd-4752-bb75-619e8dd3f9e0) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:41 user nova-compute[74241]: INFO os_vif [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:34:8b,bridge_name='br-int',has_traffic_filtering=True,id=d3a58115-3288-4a06-bd61-c751232bb9d1,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3a58115-32')
Oct 20 12:07:41 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Deleting instance files /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc_del
Oct 20 12:07:41 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Deletion of /opt/stack/data/nova/instances/fc3d7431-755e-4fb5-8c3a-21d5feee64fc_del complete
Oct 20 12:07:41 user nova-compute[74241]: INFO nova.compute.manager [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 12:07:41 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:41 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:07:42 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Took 0.48 seconds to deallocate network for instance.
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-cef43e16-a02b-40d0-8013-864b92532691 req-80455c50-a887-4d90-9709-6786b5d46fcf service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received event network-vif-deleted-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:07:42 user nova-compute[74241]: INFO nova.compute.manager [req-cef43e16-a02b-40d0-8013-864b92532691 req-80455c50-a887-4d90-9709-6786b5d46fcf service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Neutron deleted interface d3a58115-3288-4a06-bd61-c751232bb9d1; detaching it from the instance and deleting it from the info cache
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.network.neutron [req-cef43e16-a02b-40d0-8013-864b92532691 req-80455c50-a887-4d90-9709-6786b5d46fcf service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-cef43e16-a02b-40d0-8013-864b92532691 req-80455c50-a887-4d90-9709-6786b5d46fcf service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Detach interface failed, port_id=d3a58115-3288-4a06-bd61-c751232bb9d1, reason: Instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Acquiring lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Lock "595814c8-bb69-474f-8d20-c765d6f03eab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] No waiting events found dispatching network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:07:42 user nova-compute[74241]: WARNING nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received unexpected event network-vif-plugged-9eaf149b-3d41-4c5f-ae86-015b6b0202cd for instance with vm_state active and task_state deleting.
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received event network-vif-unplugged-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] No waiting events found dispatching network-vif-unplugged-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:07:42 user nova-compute[74241]: WARNING nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received unexpected event network-vif-unplugged-d3a58115-3288-4a06-bd61-c751232bb9d1 for instance with vm_state deleted and task_state None.
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received event network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Acquiring lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] No waiting events found dispatching network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:07:42 user nova-compute[74241]: WARNING nova.compute.manager [req-2732b466-4c51-4f4c-8265-d95c35386e76 req-dfd13c70-85e1-481c-bcbb-cd08bacf317c service nova] [instance: fc3d7431-755e-4fb5-8c3a-21d5feee64fc] Received unexpected event network-vif-plugged-d3a58115-3288-4a06-bd61-c751232bb9d1 for instance with vm_state deleted and task_state None.
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:07:42 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Took 1.28 seconds to deallocate network for instance.
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:42 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Deleted allocations for instance fc3d7431-755e-4fb5-8c3a-21d5feee64fc
Oct 20 12:07:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-76f8fa01-2730-4e8f-b2aa-d3f7c3c235e9 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "fc3d7431-755e-4fb5-8c3a-21d5feee64fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:44 user nova-compute[74241]: DEBUG nova.compute.manager [req-d903c893-54d1-4af3-bacd-ae6c0901a52d req-2a507c3f-6fbd-410b-a4a6-0813fac7dacb service nova] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Received event network-vif-deleted-9eaf149b-3d41-4c5f-ae86-015b6b0202cd {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:07:46 user nova-compute[74241]: INFO nova.compute.manager [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 595814c8-bb69-474f-8d20-c765d6f03eab] Took 4.19 seconds to detach 1 volumes for instance.
Oct 20 12:07:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:46 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:07:46 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:07:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:46 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Deleted allocations for instance 595814c8-bb69-474f-8d20-c765d6f03eab
Oct 20 12:07:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-05f03f6f-6048-4a49-b5a8-9441ac2b4155 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "595814c8-bb69-474f-8d20-c765d6f03eab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.224s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:07:49 user nova-compute[74241]: INFO nova.compute.manager [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attaching volume 081132a6-1551-4a4e-a649-1cbd7c47fcb6 to /dev/vdb
Oct 20 12:07:49 user nova-compute[74241]: DEBUG os_brick.utils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a698b857-07b6-42a5-aac1-f873844ff8d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6783558-0b25-4fa4-8a34-69aa6e0ba4cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1240fc06-8b5a-4a40-aee6-cbe05f1399f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49bd2eb-2d80-401d-80f2-1d7538654fb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:07:49 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:07:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a837bd4-e6a1-4462-8cc2-30c6613a7fd8]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG os_brick.utils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:07:49 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating existing volume attachment record: cf706403-4122-489e-96af-7bbbc280fc54 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:07:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:07:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:07:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'divSLKjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:08:07 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:08:07 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:08:07 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ebf7d-a1b4-480a-9945-ed9288c59a33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:08:07 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[542fc823-0ff3-408e-86cb-ae684b35823b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6] added
Oct 20 12:08:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b073168b-e23c-4f8b-8dac-0e91601ccb1b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6350d7b9-c2b1-4b1b-8fae-6f3ff7839121]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v divSLKjM {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v divSLKjM" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a033b81-17f4-43b0-82ad-3826ce34c5c9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'divSLKjM'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98ed485-e904-4f09-9efa-32d4c9f99379]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f626183a-6bb3-4346-a13c-26d6425886e2]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace2c7f1-1967-42f1-b105-73ac00ab45b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6, portal: 172.16.0.220,3260]
Oct 20 12:08:07 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6, portal: 172.16.0.220,3260] successful.
Oct 20 12:08:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[76330975-7f2d-4f9e-9b28-d35077ff993d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2fe108-4502-41d6-b7b8-efd1f92ff941]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)
Oct 20 12:08:07 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d901c-cf68-4fc3-8581-cc8a26f2c0fd]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:08:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'divSLKjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:08:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:08:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23832353834306662', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:08:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832353834306662', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:08:08 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:08:08 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 12:08:08 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:08:08 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:08:08 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:08:08 user nova-compute[74241]:   <serial>081132a6-1551-4a4e-a649-1cbd7c47fcb6</serial>
Oct 20 12:08:08 user nova-compute[74241]: </disk>
Oct 20 12:08:08 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 12:08:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:08:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:08:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No VIF found with MAC fa:16:3e:61:a2:5a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:08:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f1e02d97-3c8e-4eab-9ec9-84d389b7c653 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.761s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:11 user nova-compute[74241]: INFO nova.compute.manager [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Detaching volume 081132a6-1551-4a4e-a649-1cbd7c47fcb6
Oct 20 12:08:11 user nova-compute[74241]: INFO nova.virt.block_device [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attempting to driver detach volume 081132a6-1551-4a4e-a649-1cbd7c47fcb6 from mountpoint /dev/vdb
Oct 20 12:08:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Attempting to detach device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:08:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:08:11 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:08:11 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:08:11 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:08:11 user nova-compute[74241]:   <serial>081132a6-1551-4a4e-a649-1cbd7c47fcb6</serial>
Oct 20 12:08:11 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:08:11 user nova-compute[74241]: </disk>
Oct 20 12:08:11 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:08:11 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully detached device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the persistent domain config.
Oct 20 12:08:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:08:11 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:08:11 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:08:11 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:08:11 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:08:11 user nova-compute[74241]:   <serial>081132a6-1551-4a4e-a649-1cbd7c47fcb6</serial>
Oct 20 12:08:11 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:08:11 user nova-compute[74241]: </disk>
Oct 20 12:08:11 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:08:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:08:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-4e7d261f-3fda-422b-ba6a-7cf32f734a4b req-23c75cfd-8d12-4cac-b8e2-494f6eeab349 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received event network-changed-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-4e7d261f-3fda-422b-ba6a-7cf32f734a4b req-23c75cfd-8d12-4cac-b8e2-494f6eeab349 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Refreshing instance network info cache due to event network-changed-242a027b-a062-4afc-83ea-ae26aabeb85c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:08:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4e7d261f-3fda-422b-ba6a-7cf32f734a4b req-23c75cfd-8d12-4cac-b8e2-494f6eeab349 service nova] Acquiring lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:08:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4e7d261f-3fda-422b-ba6a-7cf32f734a4b req-23c75cfd-8d12-4cac-b8e2-494f6eeab349 service nova] Acquired lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:08:12 user nova-compute[74241]: DEBUG nova.network.neutron [req-4e7d261f-3fda-422b-ba6a-7cf32f734a4b req-23c75cfd-8d12-4cac-b8e2-494f6eeab349 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Refreshing network info cache for port 242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-4e7d261f-3fda-422b-ba6a-7cf32f734a4b req-23c75cfd-8d12-4cac-b8e2-494f6eeab349 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Updated VIF entry in instance network info cache for port 242a027b-a062-4afc-83ea-ae26aabeb85c. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-4e7d261f-3fda-422b-ba6a-7cf32f734a4b req-23c75cfd-8d12-4cac-b8e2-494f6eeab349 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Updating instance_info_cache with network_info: [{"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-4e7d261f-3fda-422b-ba6a-7cf32f734a4b req-23c75cfd-8d12-4cac-b8e2-494f6eeab349 service nova] Releasing lock "refresh_cache-3b63c384-23ec-404c-befd-c6792705d33b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "3b63c384-23ec-404c-befd-c6792705d33b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3b63c384-23ec-404c-befd-c6792705d33b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "3b63c384-23ec-404c-befd-c6792705d33b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:13 user nova-compute[74241]: INFO nova.compute.manager [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Terminating instance
Oct 20 12:08:13 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-bc29a966-e3bd-45dc-867f-f91dce91ba3d req-4bb8767d-f8b5-4f12-81e9-ac6e2f387060 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received event network-vif-unplugged-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc29a966-e3bd-45dc-867f-f91dce91ba3d req-4bb8767d-f8b5-4f12-81e9-ac6e2f387060 service nova] Acquiring lock "3b63c384-23ec-404c-befd-c6792705d33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc29a966-e3bd-45dc-867f-f91dce91ba3d req-4bb8767d-f8b5-4f12-81e9-ac6e2f387060 service nova] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bc29a966-e3bd-45dc-867f-f91dce91ba3d req-4bb8767d-f8b5-4f12-81e9-ac6e2f387060 service nova] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-bc29a966-e3bd-45dc-867f-f91dce91ba3d req-4bb8767d-f8b5-4f12-81e9-ac6e2f387060 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] No waiting events found dispatching network-vif-unplugged-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-bc29a966-e3bd-45dc-867f-f91dce91ba3d req-4bb8767d-f8b5-4f12-81e9-ac6e2f387060 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received event network-vif-unplugged-242a027b-a062-4afc-83ea-ae26aabeb85c for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Instance destroyed successfully.
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'resources' on Instance uuid 3b63c384-23ec-404c-befd-c6792705d33b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:05:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-991360223',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-991360223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-991360223',id=46,image_ref='0d21445b-fdc2-4599-b281-c2531d8274e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgV4zOicXLTGehwSJkQ+Uh5u2JnMVR2DKZtwFRuQ2gqWJnu6O7Jp5SVWZLUGshbCwYmp53w6/ikT3SOrE9wToMEfP6OetCJUuQvQDFHVNU4yq85VsBYVMArc6LjaEwIPA==',key_name='tempest-keypair-1892085390',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-z9kyz6d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-71867186',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:06:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf5346976b7f45e1b146911555f458eb',uuid=3b63c384-23ec-404c-befd-c6792705d33b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "242a027b-a062-4afc-83ea-ae26aabeb85c", "address": "fa:16:3e:d3:dc:48", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap242a027b-a0", "ovs_interfaceid": "242a027b-a062-4afc-83ea-ae26aabeb85c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:dc:48,bridge_name='br-int',has_traffic_filtering=True,id=242a027b-a062-4afc-83ea-ae26aabeb85c,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242a027b-a0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_vif [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:dc:48,bridge_name='br-int',has_traffic_filtering=True,id=242a027b-a062-4afc-83ea-ae26aabeb85c,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242a027b-a0') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap242a027b-a0, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34a5bf75-c339-4060-9091-d8801ed59f28) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:14 user nova-compute[74241]: INFO os_vif [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:dc:48,bridge_name='br-int',has_traffic_filtering=True,id=242a027b-a062-4afc-83ea-ae26aabeb85c,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap242a027b-a0')
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFLCXxuK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:08:14 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81dff57-0631-4341-aeda-4d52c2cb0a8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:08:14 user nova-compute[74241]: No targets found.
Oct 20 12:08:14 user nova-compute[74241]: iSNS:
Oct 20 12:08:14 user nova-compute[74241]: No targets found.
Oct 20 12:08:14 user nova-compute[74241]: STATIC:
Oct 20 12:08:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86
Oct 20 12:08:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:08:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:08:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:08:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:08:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:08:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767
Oct 20 12:08:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:08:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:08:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6
Oct 20 12:08:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:08:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:08:14 user nova-compute[74241]: FIRMWARE:
Oct 20 12:08:14 user nova-compute[74241]: No targets found.
Oct 20 12:08:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:08:14 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:08:14 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc447b61-3432-4ef5-b3cb-0fb328f03013]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ec8423-4a0a-4421-987b-f296257e44d6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:08:14 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:08:14 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:08:14 user nova-compute[74241]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)
Oct 20 12:08:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:08:14 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:08:14 user nova-compute[74241]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 (non-flash)
Oct 20 12:08:14 user nova-compute[74241]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)
Oct 20 12:08:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52283770a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767'): ({'sdf'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Removing single pathed devices sdf {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6484d0ce-4b17-4f13-86dc-cd35a8086467]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f61aac5-65cf-4797-8dcd-0ff2512af82d]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flushing IO for device /dev/sdf {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a98e3fb-c553-4791-b345-1422f61f67ea]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a78b18-ea72-4ebf-95c1-916a021b2229]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] SCSI volumes sdf have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b18842', '/dev/disk/by-id/scsi-1SCST_BIOb18842-c32844194a599796', '/dev/disk/by-id/scsi-26333323834343139') {{(pid=85185) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aaf337-47b6-4c3f-937d-29f1ccf8fe11]: (4, None) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d48b88b-ee33-4b46-8ffd-8f6b2e26cc66]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b451801-757a-4e94-9e38-ee725c9b86d1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767, portal: 172.16.0.220,3260]
Oct 20 12:08:14 user nova-compute[74241]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767, portal: 172.16.0.220,3260] successful.
Oct 20 12:08:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee37b6d0-f0a2-46df-b0fc-99e110f80779]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== disconnect_volume: return (313ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:08:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Deleting instance files /opt/stack/data/nova/instances/3b63c384-23ec-404c-befd-c6792705d33b_del
Oct 20 12:08:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Deletion of /opt/stack/data/nova/instances/3b63c384-23ec-404c-befd-c6792705d33b_del complete
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:14 user nova-compute[74241]: INFO nova.compute.manager [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:08:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:08:15 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Took 0.68 seconds to deallocate network for instance.
Oct 20 12:08:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-a78f14f5-12e7-49ab-85ef-8c87b8e51d2d req-0e07bbdb-b730-4d5e-bc4d-0b0a45a0fe20 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received event network-vif-deleted-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:15 user nova-compute[74241]: INFO nova.compute.manager [req-a78f14f5-12e7-49ab-85ef-8c87b8e51d2d req-0e07bbdb-b730-4d5e-bc4d-0b0a45a0fe20 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Neutron deleted interface 242a027b-a062-4afc-83ea-ae26aabeb85c; detaching it from the instance and deleting it from the info cache
Oct 20 12:08:15 user nova-compute[74241]: DEBUG nova.network.neutron [req-a78f14f5-12e7-49ab-85ef-8c87b8e51d2d req-0e07bbdb-b730-4d5e-bc4d-0b0a45a0fe20 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-a78f14f5-12e7-49ab-85ef-8c87b8e51d2d req-0e07bbdb-b730-4d5e-bc4d-0b0a45a0fe20 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Detach interface failed, port_id=242a027b-a062-4afc-83ea-ae26aabeb85c, reason: Instance 3b63c384-23ec-404c-befd-c6792705d33b could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-e832ad31-cee7-4bcf-ae08-57e73fab3e72 req-31c7f637-7e13-4af1-91db-617d9dfcf656 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received event network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e832ad31-cee7-4bcf-ae08-57e73fab3e72 req-31c7f637-7e13-4af1-91db-617d9dfcf656 service nova] Acquiring lock "3b63c384-23ec-404c-befd-c6792705d33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e832ad31-cee7-4bcf-ae08-57e73fab3e72 req-31c7f637-7e13-4af1-91db-617d9dfcf656 service nova] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e832ad31-cee7-4bcf-ae08-57e73fab3e72 req-31c7f637-7e13-4af1-91db-617d9dfcf656 service nova] Lock "3b63c384-23ec-404c-befd-c6792705d33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-e832ad31-cee7-4bcf-ae08-57e73fab3e72 req-31c7f637-7e13-4af1-91db-617d9dfcf656 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] No waiting events found dispatching network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:08:15 user nova-compute[74241]: WARNING nova.compute.manager [req-e832ad31-cee7-4bcf-ae08-57e73fab3e72 req-31c7f637-7e13-4af1-91db-617d9dfcf656 service nova] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Received unexpected event network-vif-plugged-242a027b-a062-4afc-83ea-ae26aabeb85c for instance with vm_state active and task_state deleting.
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:16 user nova-compute[74241]: INFO nova.compute.manager [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Took 0.96 seconds to detach 1 volumes for instance.
Oct 20 12:08:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3b63c384-23ec-404c-befd-c6792705d33b] Deleting volume: ce0fd4ab-aa6f-4146-a9c6-dee0cef79767 {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 12:08:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:16 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:08:16 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:08:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8428MB free_disk=24.84980010986328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:08:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.245s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:17 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Deleted allocations for instance 3b63c384-23ec-404c-befd-c6792705d33b
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 1803c43a-de8a-432b-a98e-2b3cdf72e514 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6b1b4af5-ce56-4e71-89fb-60e216fd25c2 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3b63c384-23ec-404c-befd-c6792705d33b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.703s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:08:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:08:18 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 48613baf-40b5-4648-a8af-6d96ab7a245b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:08:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updating instance_info_cache with network_info: [{"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:08:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-48613baf-40b5-4648-a8af-6d96ab7a245b" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:08:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:08:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:21 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:08:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:08:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:08:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:08:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:08:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:30 user nova-compute[74241]: INFO nova.compute.manager [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Terminating instance
Oct 20 12:08:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-67b797fa-5df6-47b8-a695-99b07da97e0a req-2d0ac277-019f-4154-adee-b69d03161550 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received event network-vif-unplugged-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-67b797fa-5df6-47b8-a695-99b07da97e0a req-2d0ac277-019f-4154-adee-b69d03161550 service nova] Acquiring lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-67b797fa-5df6-47b8-a695-99b07da97e0a req-2d0ac277-019f-4154-adee-b69d03161550 service nova] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-67b797fa-5df6-47b8-a695-99b07da97e0a req-2d0ac277-019f-4154-adee-b69d03161550 service nova] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-67b797fa-5df6-47b8-a695-99b07da97e0a req-2d0ac277-019f-4154-adee-b69d03161550 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] No waiting events found dispatching network-vif-unplugged-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:08:30 user nova-compute[74241]: DEBUG nova.compute.manager [req-67b797fa-5df6-47b8-a695-99b07da97e0a req-2d0ac277-019f-4154-adee-b69d03161550 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received event network-vif-unplugged-df35f627-1cec-4985-8660-113106363b55 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:31 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Instance destroyed successfully.
Oct 20 12:08:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'resources' on Instance uuid fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:58:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714721487',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714721487',id=38,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:58:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-hhup83ep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:00:14Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "df35f627-1cec-4985-8660-113106363b55", "address": "fa:16:3e:ee:2b:37", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf35f627-1c", "ovs_interfaceid": "df35f627-1cec-4985-8660-113106363b55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:2b:37,bridge_name='br-int',has_traffic_filtering=True,id=df35f627-1cec-4985-8660-113106363b55,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf35f627-1c') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG os_vif [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:2b:37,bridge_name='br-int',has_traffic_filtering=True,id=df35f627-1cec-4985-8660-113106363b55,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf35f627-1c') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf35f627-1c, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6439c409-e7cf-4b90-92df-83f32e4559c8) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:08:31 user nova-compute[74241]: INFO os_vif [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:2b:37,bridge_name='br-int',has_traffic_filtering=True,id=df35f627-1cec-4985-8660-113106363b55,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf35f627-1c')
Oct 20 12:08:31 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Deleting instance files /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94_del
Oct 20 12:08:31 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Deletion of /opt/stack/data/nova/instances/fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94_del complete
Oct 20 12:08:31 user nova-compute[74241]: INFO nova.compute.manager [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Took 0.80 seconds to destroy the instance on the hypervisor.
Oct 20 12:08:31 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:08:31 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Took 0.46 seconds to deallocate network for instance.
Oct 20 12:08:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:32 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Deleted allocations for instance fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-ca2a7838-7059-419b-a9fd-3ab9e6c377f6 tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.730s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:32 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 is timed out.
Oct 20 12:08:32 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully detached device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the live domain config.
Oct 20 12:08:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'divSLKjM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:08:32 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2884f55d-d919-4a29-a1b3-30c74f05e88e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:08:32 user nova-compute[74241]: No targets found.
Oct 20 12:08:32 user nova-compute[74241]: iSNS:
Oct 20 12:08:32 user nova-compute[74241]: No targets found.
Oct 20 12:08:32 user nova-compute[74241]: STATIC:
Oct 20 12:08:32 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86
Oct 20 12:08:32 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:08:32 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:08:32 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:08:32 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:08:32 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:08:32 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6
Oct 20 12:08:32 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:08:32 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:08:32 user nova-compute[74241]: FIRMWARE:
Oct 20 12:08:32 user nova-compute[74241]: No targets found.
Oct 20 12:08:32 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:08:32 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:08:32 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5092e08-81c5-4d07-bfe3-f1da23cf57a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea43934e-856c-4a33-bbcb-0691d2eb8c9c]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:08:32 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:08:32 user nova-compute[74241]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)
Oct 20 12:08:32 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:08:32 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:08:32 user nova-compute[74241]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 (non-flash)
Oct 20 12:08:32 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52086c2c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab4ff35-4628-4412-bdad-91dff0be74ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f19663a-d068-4d91-bb61-230e79626403]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25a8b9c-b776-4fbf-aa74-8bbebfd58737]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee083b4a-1782-41bb-a64d-dcab2141278a]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f917bc9a-9e89-433a-81b3-c686d0206550]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[576236d3-4ef0-47f1-9ab6-0dae6be36a0e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6, portal: 172.16.0.220,3260]
Oct 20 12:08:32 user nova-compute[74241]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6, portal: 172.16.0.220,3260] successful.
Oct 20 12:08:32 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:081132a6-1551-4a4e-a649-1cbd7c47fcb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[674061ea-ed2a-4dd2-9446-2f5cc4ee0a4a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== disconnect_volume: return (318ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-08bac801-9e6d-47bc-9d40-ffe4db3b1109 req-e39026e6-bfbe-454f-80d4-087fc678aa85 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received event network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-08bac801-9e6d-47bc-9d40-ffe4db3b1109 req-e39026e6-bfbe-454f-80d4-087fc678aa85 service nova] Acquiring lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-08bac801-9e6d-47bc-9d40-ffe4db3b1109 req-e39026e6-bfbe-454f-80d4-087fc678aa85 service nova] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-08bac801-9e6d-47bc-9d40-ffe4db3b1109 req-e39026e6-bfbe-454f-80d4-087fc678aa85 service nova] Lock "fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-08bac801-9e6d-47bc-9d40-ffe4db3b1109 req-e39026e6-bfbe-454f-80d4-087fc678aa85 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] No waiting events found dispatching network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:08:32 user nova-compute[74241]: WARNING nova.compute.manager [req-08bac801-9e6d-47bc-9d40-ffe4db3b1109 req-e39026e6-bfbe-454f-80d4-087fc678aa85 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received unexpected event network-vif-plugged-df35f627-1cec-4985-8660-113106363b55 for instance with vm_state deleted and task_state None.
Oct 20 12:08:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-08bac801-9e6d-47bc-9d40-ffe4db3b1109 req-e39026e6-bfbe-454f-80d4-087fc678aa85 service nova] [instance: fc9165ca-5f4c-4d57-9e95-1fed6cd7fd94] Received event network-vif-deleted-df35f627-1cec-4985-8660-113106363b55 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:40 user nova-compute[74241]: DEBUG nova.objects.instance [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:08:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-bf4ff42b-1775-4c66-9986-d2f3aecf2e55 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.763s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Verify base images {{(pid=74241) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Image id f9a80c7e-66e2-4915-96f8-63e828cf6c2e yields fingerprint 27213cb42d3420a49f9359954e8f904dea393555 {{(pid=74241) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 12:08:41 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] image f9a80c7e-66e2-4915-96f8-63e828cf6c2e at (/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555): checking
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] image f9a80c7e-66e2-4915-96f8-63e828cf6c2e at (/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555): image is in use {{(pid=74241) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74241) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] 6867fddf-3915-4ddc-b996-f003a4d46e99 is a valid instance name {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] 6867fddf-3915-4ddc-b996-f003a4d46e99 has a disk file {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 is backed by 27213cb42d3420a49f9359954e8f904dea393555 {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] 8c3d85a7-f4a9-4998-be6a-d50078f02658 is a valid instance name {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] 8c3d85a7-f4a9-4998-be6a-d50078f02658 has a disk file {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 12:08:41 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 8c3d85a7-f4a9-4998-be6a-d50078f02658 is backed by 27213cb42d3420a49f9359954e8f904dea393555 {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 is a valid instance name {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] 48613baf-40b5-4648-a8af-6d96ab7a245b is a valid instance name {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] 48613baf-40b5-4648-a8af-6d96ab7a245b has a disk file {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b is backed by 27213cb42d3420a49f9359954e8f904dea393555 {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] 1803c43a-de8a-432b-a98e-2b3cdf72e514 is a valid instance name {{(pid=74241) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 12:08:42 user nova-compute[74241]: WARNING nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874
Oct 20 12:08:42 user nova-compute[74241]: WARNING nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Unknown base file: /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb
Oct 20 12:08:42 user nova-compute[74241]: WARNING nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c
Oct 20 12:08:42 user nova-compute[74241]: WARNING nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6
Oct 20 12:08:42 user nova-compute[74241]: WARNING nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207
Oct 20 12:08:42 user nova-compute[74241]: WARNING nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Unknown base file: /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0
Oct 20 12:08:42 user nova-compute[74241]: WARNING nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Unknown base file: /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Active base files: /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Removable base files: /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874 /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6 /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207 /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0 /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d1b5cedfe64d25eb4eedd3f40bc62c26cfdde874
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/46a20eb8fbcf0150e71c71faa522f359400860fb
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f3447870663cc21a765ad0f324a9267010b5d22c
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8baf0eefefb3afb4b6b6d2f3619b40f5ef9db0a6
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b2affe9803e597d471e96f8d318cb898a4382207
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/034ed09460dc7edc12324291985fe69e569f7dc0
Oct 20 12:08:42 user nova-compute[74241]: INFO nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/555f526a2fe6601af8bf6f2d52860e11d5306864
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Verification complete {{(pid=74241) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Verify swap images {{(pid=74241) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 20 12:08:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.imagecache [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Verify ephemeral images {{(pid=74241) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 20 12:08:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-240adb37-2b35-4406-b366-375babdd7c5c req-7f888cd0-5304-4ad9-b4e8-c8fbf4d22f9e service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-changed-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-240adb37-2b35-4406-b366-375babdd7c5c req-7f888cd0-5304-4ad9-b4e8-c8fbf4d22f9e service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Refreshing instance network info cache due to event network-changed-f8d95c60-7d6f-4149-97b8-a6058f80f69b. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-240adb37-2b35-4406-b366-375babdd7c5c req-7f888cd0-5304-4ad9-b4e8-c8fbf4d22f9e service nova] Acquiring lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-240adb37-2b35-4406-b366-375babdd7c5c req-7f888cd0-5304-4ad9-b4e8-c8fbf4d22f9e service nova] Acquired lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG nova.network.neutron [req-240adb37-2b35-4406-b366-375babdd7c5c req-7f888cd0-5304-4ad9-b4e8-c8fbf4d22f9e service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Refreshing network info cache for port f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:50 user nova-compute[74241]: INFO nova.compute.manager [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Terminating instance
Oct 20 12:08:50 user nova-compute[74241]: DEBUG nova.compute.manager [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.network.neutron [req-240adb37-2b35-4406-b366-375babdd7c5c req-7f888cd0-5304-4ad9-b4e8-c8fbf4d22f9e service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updated VIF entry in instance network info cache for port f8d95c60-7d6f-4149-97b8-a6058f80f69b. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.network.neutron [req-240adb37-2b35-4406-b366-375babdd7c5c req-7f888cd0-5304-4ad9-b4e8-c8fbf4d22f9e service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updating instance_info_cache with network_info: [{"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-240adb37-2b35-4406-b366-375babdd7c5c req-7f888cd0-5304-4ad9-b4e8-c8fbf4d22f9e service nova] Releasing lock "refresh_cache-8c3d85a7-f4a9-4998-be6a-d50078f02658" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-6af887da-32ba-4be1-9e59-fb46c8472e94 req-0d4adabc-1d59-40ec-b2e0-2237fe55c936 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-vif-unplugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6af887da-32ba-4be1-9e59-fb46c8472e94 req-0d4adabc-1d59-40ec-b2e0-2237fe55c936 service nova] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6af887da-32ba-4be1-9e59-fb46c8472e94 req-0d4adabc-1d59-40ec-b2e0-2237fe55c936 service nova] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6af887da-32ba-4be1-9e59-fb46c8472e94 req-0d4adabc-1d59-40ec-b2e0-2237fe55c936 service nova] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-6af887da-32ba-4be1-9e59-fb46c8472e94 req-0d4adabc-1d59-40ec-b2e0-2237fe55c936 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] No waiting events found dispatching network-vif-unplugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.compute.manager [req-6af887da-32ba-4be1-9e59-fb46c8472e94 req-0d4adabc-1d59-40ec-b2e0-2237fe55c936 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-vif-unplugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Instance destroyed successfully.
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.objects.instance [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lazy-loading 'resources' on Instance uuid 8c3d85a7-f4a9-4998-be6a-d50078f02658 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-84834588',display_name='tempest-TestStampPattern-server-84834588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-84834588',id=41,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKjNjBfodxRSr5YvavNS/uQaM3H/sSuwdLpiLie0Gc+zlYN3eiXZGDk/CPuRUr1nTvtuenQYt1ietTjwkbxk07PqaQmzMx7LgbHmAAcY8qdVSzmBI9C6xbIafIRctDz+Q==',key_name='tempest-TestStampPattern-37297663',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12c1d28fe5a7414ca1aa84dbd092eb26',ramdisk_id='',reservation_id='r-ufoggsso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-372523597',owner_user_name='tempest-TestStampPattern-372523597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:04:00Z,user_data=None,user_id='96bd8e533fb44c298f5ef17bbbd6ef5b',uuid=8c3d85a7-f4a9-4998-be6a-d50078f02658,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converting VIF {"id": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "address": "fa:16:3e:6c:6a:16", "network": {"id": "73d87421-3e87-4407-834c-332da8ff2b63", "bridge": "br-int", "label": "tempest-TestStampPattern-491685609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12c1d28fe5a7414ca1aa84dbd092eb26", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8d95c60-7d", "ovs_interfaceid": "f8d95c60-7d6f-4149-97b8-a6058f80f69b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=f8d95c60-7d6f-4149-97b8-a6058f80f69b,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d95c60-7d') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG os_vif [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=f8d95c60-7d6f-4149-97b8-a6058f80f69b,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d95c60-7d') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8d95c60-7d, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f7241bc-cf31-4af1-8c68-a27511369ea8) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:08:51 user nova-compute[74241]: INFO os_vif [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:6a:16,bridge_name='br-int',has_traffic_filtering=True,id=f8d95c60-7d6f-4149-97b8-a6058f80f69b,network=Network(73d87421-3e87-4407-834c-332da8ff2b63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8d95c60-7d')
Oct 20 12:08:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Deleting instance files /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658_del
Oct 20 12:08:51 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Deletion of /opt/stack/data/nova/instances/8c3d85a7-f4a9-4998-be6a-d50078f02658_del complete
Oct 20 12:08:51 user nova-compute[74241]: INFO nova.compute.manager [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 12:08:51 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:08:51 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Took 0.39 seconds to deallocate network for instance.
Oct 20 12:08:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:51 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:52 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:08:52 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:08:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:52 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Deleted allocations for instance 8c3d85a7-f4a9-4998-be6a-d50078f02658
Oct 20 12:08:52 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-448c960b-4dc8-419b-9abb-93f6125dc100 tempest-TestStampPattern-372523597 tempest-TestStampPattern-372523597-project-member] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.711s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-339689b2-641b-4126-82e6-4c938ed5d874 req-6e789b5b-2380-4b87-89e1-dbcf3a0bf564 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-339689b2-641b-4126-82e6-4c938ed5d874 req-6e789b5b-2380-4b87-89e1-dbcf3a0bf564 service nova] Acquiring lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:08:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-339689b2-641b-4126-82e6-4c938ed5d874 req-6e789b5b-2380-4b87-89e1-dbcf3a0bf564 service nova] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:08:53 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-339689b2-641b-4126-82e6-4c938ed5d874 req-6e789b5b-2380-4b87-89e1-dbcf3a0bf564 service nova] Lock "8c3d85a7-f4a9-4998-be6a-d50078f02658-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:08:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-339689b2-641b-4126-82e6-4c938ed5d874 req-6e789b5b-2380-4b87-89e1-dbcf3a0bf564 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] No waiting events found dispatching network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:08:53 user nova-compute[74241]: WARNING nova.compute.manager [req-339689b2-641b-4126-82e6-4c938ed5d874 req-6e789b5b-2380-4b87-89e1-dbcf3a0bf564 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received unexpected event network-vif-plugged-f8d95c60-7d6f-4149-97b8-a6058f80f69b for instance with vm_state deleted and task_state None.
Oct 20 12:08:53 user nova-compute[74241]: DEBUG nova.compute.manager [req-339689b2-641b-4126-82e6-4c938ed5d874 req-6e789b5b-2380-4b87-89e1-dbcf3a0bf564 service nova] [instance: 8c3d85a7-f4a9-4998-be6a-d50078f02658] Received event network-vif-deleted-f8d95c60-7d6f-4149-97b8-a6058f80f69b {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:08:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG nova.objects.instance [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:07 user nova-compute[74241]: INFO nova.compute.manager [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attaching volume 2d98c422-18d7-43d8-9032-a9b8adb1c072 to /dev/vdb
Oct 20 12:09:07 user nova-compute[74241]: DEBUG os_brick.utils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc78e0af-d2b4-4bad-a72d-d890ebf5e429]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c0156-3232-4ed9-bb39-7c3bae916538]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ace0b6-4bb7-40e2-99ac-b7ded560949b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1284880b-e6b2-47bb-a3c5-2be856555aee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:09:07 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:09:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0f41e-ca8e-464b-920c-9a55ea304d9d]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG os_brick.utils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:09:07 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating existing volume attachment record: 3c9cb496-e6b5-4c3e-a682-507c79c0532c {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:09:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:10 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "1803c43a-de8a-432b-a98e-2b3cdf72e514" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:13 user nova-compute[74241]: INFO nova.compute.manager [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Terminating instance
Oct 20 12:09:13 user nova-compute[74241]: DEBUG nova.compute.manager [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-138bb024-c3c0-46d6-ab8b-872ffe2fcab6 req-1fa526af-de26-40f5-9be8-f621b01f5a51 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received event network-vif-unplugged-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-138bb024-c3c0-46d6-ab8b-872ffe2fcab6 req-1fa526af-de26-40f5-9be8-f621b01f5a51 service nova] Acquiring lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-138bb024-c3c0-46d6-ab8b-872ffe2fcab6 req-1fa526af-de26-40f5-9be8-f621b01f5a51 service nova] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-138bb024-c3c0-46d6-ab8b-872ffe2fcab6 req-1fa526af-de26-40f5-9be8-f621b01f5a51 service nova] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-138bb024-c3c0-46d6-ab8b-872ffe2fcab6 req-1fa526af-de26-40f5-9be8-f621b01f5a51 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] No waiting events found dispatching network-vif-unplugged-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:09:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-138bb024-c3c0-46d6-ab8b-872ffe2fcab6 req-1fa526af-de26-40f5-9be8-f621b01f5a51 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received event network-vif-unplugged-bf83966d-d350-4695-87e3-dc66f3c89efb for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Instance destroyed successfully.
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.objects.instance [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'resources' on Instance uuid 1803c43a-de8a-432b-a98e-2b3cdf72e514 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1195578327',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1195578327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1195578327',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZKdjT9XujEi7YMnCHBw8h7cQ5KsTelEYfokG4rluySPp2ZxbftpFQwNjKz8asC2Ru2v/eD8+3UWJ724cgPGCr7v0BHh3NqXVKF3cyn4o+qqib1sNIEhb+6JL33OfIvfg==',key_name='tempest-keypair-2126739835',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:03:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-tqxdoous',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf5346976b7f45e1b146911555f458eb',uuid=1803c43a-de8a-432b-a98e-2b3cdf72e514,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "bf83966d-d350-4695-87e3-dc66f3c89efb", "address": "fa:16:3e:8a:d7:5c", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf83966d-d3", "ovs_interfaceid": "bf83966d-d350-4695-87e3-dc66f3c89efb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d7:5c,bridge_name='br-int',has_traffic_filtering=True,id=bf83966d-d350-4695-87e3-dc66f3c89efb,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf83966d-d3') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_vif [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d7:5c,bridge_name='br-int',has_traffic_filtering=True,id=bf83966d-d350-4695-87e3-dc66f3c89efb,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf83966d-d3') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf83966d-d3, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4aa07b6-f914-41da-a23d-bd8274c20bf6) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:09:14 user nova-compute[74241]: INFO os_vif [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d7:5c,bridge_name='br-int',has_traffic_filtering=True,id=bf83966d-d350-4695-87e3-dc66f3c89efb,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf83966d-d3')
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EQUdOwuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:09:14 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f5a626-9a47-4c0a-bca4-c99fd4bc9161]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:09:14 user nova-compute[74241]: No targets found.
Oct 20 12:09:14 user nova-compute[74241]: iSNS:
Oct 20 12:09:14 user nova-compute[74241]: No targets found.
Oct 20 12:09:14 user nova-compute[74241]: STATIC:
Oct 20 12:09:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86
Oct 20 12:09:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:09:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:09:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:09:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:09:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:09:14 user nova-compute[74241]: FIRMWARE:
Oct 20 12:09:14 user nova-compute[74241]: No targets found.
Oct 20 12:09:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:09:14 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:09:14 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bd48be-1380-40bc-8ffd-8e657e2e2842]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4179ea-2763-45b7-a835-8adfe345054d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:09:14 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:09:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:09:14 user nova-compute[74241]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 (non-flash)
Oct 20 12:09:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5228314f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cc5ca4-ee33-4b96-a45f-7451df301435]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f85f54-970b-459b-a352-03811add531d]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e299bd1-bcd8-49f0-81f4-cdbc14d93c18]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa88de9-4d62-4b3d-ae7e-21957af40f8b]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fef5ac27', '/dev/disk/by-id/scsi-26132323530366132', '/dev/disk/by-id/scsi-1SCST_BIOfef5ac27-a22506a24164aaa9') {{(pid=85185) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaeb956-725b-45f6-8115-ab49ffc26a4f]: (4, None) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc91220e-65fc-41fd-93ac-6ab576ad8d7e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4582f0a-6330-44d4-86e7-4d498b2b0ddf]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86, portal: 172.16.0.220,3260]
Oct 20 12:09:14 user nova-compute[74241]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86, portal: 172.16.0.220,3260] successful.
Oct 20 12:09:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0037c894-2b45-4c51-9159-cb906752fb86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d03c993-8232-4fa8-bde5-330266c01512]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== disconnect_volume: return (302ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:09:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Deleting instance files /opt/stack/data/nova/instances/1803c43a-de8a-432b-a98e-2b3cdf72e514_del
Oct 20 12:09:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Deletion of /opt/stack/data/nova/instances/1803c43a-de8a-432b-a98e-2b3cdf72e514_del complete
Oct 20 12:09:14 user nova-compute[74241]: INFO nova.compute.manager [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-065bed02-ee4b-44e8-b0ac-89167f8ca5fd req-4f7611fa-2794-40b2-8e67-ea13fdd4e784 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received event network-vif-deleted-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:09:15 user nova-compute[74241]: INFO nova.compute.manager [req-065bed02-ee4b-44e8-b0ac-89167f8ca5fd req-4f7611fa-2794-40b2-8e67-ea13fdd4e784 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Neutron deleted interface bf83966d-d350-4695-87e3-dc66f3c89efb; detaching it from the instance and deleting it from the info cache
Oct 20 12:09:15 user nova-compute[74241]: DEBUG nova.network.neutron [req-065bed02-ee4b-44e8-b0ac-89167f8ca5fd req-4f7611fa-2794-40b2-8e67-ea13fdd4e784 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:09:15 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Took 0.62 seconds to deallocate network for instance.
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-065bed02-ee4b-44e8-b0ac-89167f8ca5fd req-4f7611fa-2794-40b2-8e67-ea13fdd4e784 service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Detach interface failed, port_id=bf83966d-d350-4695-87e3-dc66f3c89efb, reason: Instance 1803c43a-de8a-432b-a98e-2b3cdf72e514 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-71699836-61bb-4213-93f0-2ecd35182b3a req-01b808e6-b86d-4379-9cac-489c7039790c service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received event network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-71699836-61bb-4213-93f0-2ecd35182b3a req-01b808e6-b86d-4379-9cac-489c7039790c service nova] Acquiring lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-71699836-61bb-4213-93f0-2ecd35182b3a req-01b808e6-b86d-4379-9cac-489c7039790c service nova] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-71699836-61bb-4213-93f0-2ecd35182b3a req-01b808e6-b86d-4379-9cac-489c7039790c service nova] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-71699836-61bb-4213-93f0-2ecd35182b3a req-01b808e6-b86d-4379-9cac-489c7039790c service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] No waiting events found dispatching network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:09:15 user nova-compute[74241]: WARNING nova.compute.manager [req-71699836-61bb-4213-93f0-2ecd35182b3a req-01b808e6-b86d-4379-9cac-489c7039790c service nova] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Received unexpected event network-vif-plugged-bf83966d-d350-4695-87e3-dc66f3c89efb for instance with vm_state active and task_state deleting.
Oct 20 12:09:15 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:09:15 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:09:15 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8707MB free_disk=25.09103012084961GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:16 user nova-compute[74241]: INFO nova.compute.manager [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Took 0.88 seconds to detach 1 volumes for instance.
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 1803c43a-de8a-432b-a98e-2b3cdf72e514] Deleting volume: 0037c894-2b45-4c51-9159-cb906752fb86 {{(pid=74241) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 48613baf-40b5-4648-a8af-6d96ab7a245b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 1803c43a-de8a-432b-a98e-2b3cdf72e514 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.175s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:09:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:16 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Deleted allocations for instance 1803c43a-de8a-432b-a98e-2b3cdf72e514
Oct 20 12:09:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-191f3238-7ddc-4bf0-b0aa-ab23cbca59f4 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "1803c43a-de8a-432b-a98e-2b3cdf72e514" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.258s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:09:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:09:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:09:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:09:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:09:20 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating instance_info_cache with network_info: [{"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:09:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:09:20 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:09:20 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:21 user nova-compute[74241]: INFO nova.compute.manager [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Terminating instance
Oct 20 12:09:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-ed5f2941-6d25-4818-8261-0c98a7127bb0 req-5423f61d-2983-4597-870a-2abd7e63dc8f service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed5f2941-6d25-4818-8261-0c98a7127bb0 req-5423f61d-2983-4597-870a-2abd7e63dc8f service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed5f2941-6d25-4818-8261-0c98a7127bb0 req-5423f61d-2983-4597-870a-2abd7e63dc8f service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ed5f2941-6d25-4818-8261-0c98a7127bb0 req-5423f61d-2983-4597-870a-2abd7e63dc8f service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-ed5f2941-6d25-4818-8261-0c98a7127bb0 req-5423f61d-2983-4597-870a-2abd7e63dc8f service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:09:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-ed5f2941-6d25-4818-8261-0c98a7127bb0 req-5423f61d-2983-4597-870a-2abd7e63dc8f service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-unplugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Instance destroyed successfully.
Oct 20 12:09:22 user nova-compute[74241]: DEBUG nova.objects.instance [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'resources' on Instance uuid 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-822068380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-822068380',id=32,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:54:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-d71hdc0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:56:30Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=9ab397f5-6d89-4bc6-b1e5-10cb423f5f91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "address": "fa:16:3e:44:a7:8a", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cd19fc4-d5", "ovs_interfaceid": "8cd19fc4-d5a2-429e-a495-de7e92ccb893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:a7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8cd19fc4-d5a2-429e-a495-de7e92ccb893,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd19fc4-d5') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_vif [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:a7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8cd19fc4-d5a2-429e-a495-de7e92ccb893,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd19fc4-d5') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cd19fc4-d5, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76a4ca2d-ccfe-42ec-8b9d-e977dcabf0af) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:22 user nova-compute[74241]: INFO os_vif [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:a7:8a,bridge_name='br-int',has_traffic_filtering=True,id=8cd19fc4-d5a2-429e-a495-de7e92ccb893,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cd19fc4-d5')
Oct 20 12:09:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSpvcYWX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:09:22 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc00ceb-dc7e-40a0-a156-0983a9069932]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:09:22 user nova-compute[74241]: No targets found.
Oct 20 12:09:22 user nova-compute[74241]: iSNS:
Oct 20 12:09:22 user nova-compute[74241]: No targets found.
Oct 20 12:09:22 user nova-compute[74241]: STATIC:
Oct 20 12:09:22 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7
Oct 20 12:09:22 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:09:22 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:09:22 user nova-compute[74241]: FIRMWARE:
Oct 20 12:09:22 user nova-compute[74241]: No targets found.
Oct 20 12:09:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:09:22 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:09:22 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f548bb2a-6115-48e9-abe9-1bdb93b1561e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f6820f-0899-49b7-88f8-7f7b78a2f212]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:09:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 (non-flash)
Oct 20 12:09:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f522842c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7'): ({'sdd'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Removing single pathed devices sdd {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[67656749-7b91-45fc-ac06-01d9e830ad65]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[354cd5ba-1232-4a94-8dea-92f7671928e4]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Flushing IO for device /dev/sdd {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8343b116-b15a-43a3-8f30-e51d65ceae02]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0891b4ac-e65e-49d7-a17b-969b6c8f9d0f]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c2824f-c618-4250-a115-65d78b3a3dfd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45672f6-b83a-4988-8b66-54d4b9a58e1f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7, portal: 172.16.0.220,3260]
Oct 20 12:09:22 user nova-compute[74241]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7, portal: 172.16.0.220,3260] successful.
Oct 20 12:09:22 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6c9492-d5a5-4f68-b809-4a50aec8c6c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef647544-9f3f-45b7-ace5-29f5a8130fc1]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] <== disconnect_volume: return (318ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:09:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Deleting instance files /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91_del
Oct 20 12:09:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Deletion of /opt/stack/data/nova/instances/9ab397f5-6d89-4bc6-b1e5-10cb423f5f91_del complete
Oct 20 12:09:22 user nova-compute[74241]: INFO nova.compute.manager [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 20 12:09:22 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:09:22 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:09:23 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:09:23 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Took 0.55 seconds to deallocate network for instance.
Oct 20 12:09:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-e31ad054-2de9-4b40-997e-717d9ee061b5 req-fd460823-6554-4f48-9580-d5b7968799ae service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-deleted-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:09:23 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:23 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-fa67b278-4fae-4831-b3c8-75762ce66ead req-e8618b8b-3b2d-4da0-a7d6-296c537737fa service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:09:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fa67b278-4fae-4831-b3c8-75762ce66ead req-e8618b8b-3b2d-4da0-a7d6-296c537737fa service nova] Acquiring lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fa67b278-4fae-4831-b3c8-75762ce66ead req-e8618b8b-3b2d-4da0-a7d6-296c537737fa service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-fa67b278-4fae-4831-b3c8-75762ce66ead req-e8618b8b-3b2d-4da0-a7d6-296c537737fa service nova] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-fa67b278-4fae-4831-b3c8-75762ce66ead req-e8618b8b-3b2d-4da0-a7d6-296c537737fa service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] No waiting events found dispatching network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:09:23 user nova-compute[74241]: WARNING nova.compute.manager [req-fa67b278-4fae-4831-b3c8-75762ce66ead req-e8618b8b-3b2d-4da0-a7d6-296c537737fa service nova] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Received unexpected event network-vif-plugged-8cd19fc4-d5a2-429e-a495-de7e92ccb893 for instance with vm_state active and task_state deleting.
Oct 20 12:09:23 user nova-compute[74241]: INFO nova.compute.manager [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91] Took 0.86 seconds to detach 1 volumes for instance.
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:24 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Deleted allocations for instance 9ab397f5-6d89-4bc6-b1e5-10cb423f5f91
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-96f2e6a8-e408-4b4a-9ec5-5b693c6df20a tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "9ab397f5-6d89-4bc6-b1e5-10cb423f5f91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.123s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUJoEIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:09:24 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:09:24 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:09:24 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e712ee0-b8cb-48b0-b91c-a278e9b4238a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:09:24 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9496769-9bba-43f0-922a-de1f448d5e30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072] added
Oct 20 12:09:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d6051c-7f0e-454c-a6b1-70147868c6b4]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0145e77d-9230-403e-9497-1e2710917a26]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUJoEIwT {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUJoEIwT" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ddfb33-8a20-48b1-b34e-22c9836401db]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZUJoEIwT'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[610c6fbc-bcca-4031-af6d-f3d533433a7a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9b42d6-ade4-4f3f-ae18-9dcb01e1cc1d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 12:09:24 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 12:09:24 user nova-compute[74241]:  {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:09:24 user nova-compute[74241]: WARNING os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 12:09:24 user nova-compute[74241]: 
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f209ac87-cb8a-49b1-9e02-6b6bfcf83304]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072, portal: 172.16.0.220,3260]
Oct 20 12:09:24 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072, portal: 172.16.0.220,3260] successful.
Oct 20 12:09:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8debe7-0a0a-460a-8f9b-830170152f4d]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b20bfc0-786f-45f8-adc1-c0da19502626]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 (non-flash)
Oct 20 12:09:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 (non-flash)
Oct 20 12:09:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[40574ad5-3e5d-48a5-8e81-14320520bbce]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:09:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUJoEIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:09:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:09:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26431383063323262', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:09:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431383063323262', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:09:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:09:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 12:09:25 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:09:25 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:09:25 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:09:25 user nova-compute[74241]:   <serial>2d98c422-18d7-43d8-9032-a9b8adb1c072</serial>
Oct 20 12:09:25 user nova-compute[74241]: </disk>
Oct 20 12:09:25 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 12:09:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:09:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:09:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No VIF found with MAC fa:16:3e:61:a2:5a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:09:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-73a6186a-19ea-4b77-905a-3f8c23c32d18 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.168s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:09:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:09:28 user nova-compute[74241]: INFO nova.compute.manager [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Detaching volume 2d98c422-18d7-43d8-9032-a9b8adb1c072
Oct 20 12:09:28 user nova-compute[74241]: INFO nova.virt.block_device [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attempting to driver detach volume 2d98c422-18d7-43d8-9032-a9b8adb1c072 from mountpoint /dev/vdb
Oct 20 12:09:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Attempting to detach device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:09:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:09:28 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:09:28 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:09:28 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:09:28 user nova-compute[74241]:   <serial>2d98c422-18d7-43d8-9032-a9b8adb1c072</serial>
Oct 20 12:09:28 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:09:28 user nova-compute[74241]: </disk>
Oct 20 12:09:28 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:09:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully detached device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the persistent domain config.
Oct 20 12:09:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:09:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:09:28 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:09:28 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:09:28 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:09:28 user nova-compute[74241]:   <serial>2d98c422-18d7-43d8-9032-a9b8adb1c072</serial>
Oct 20 12:09:28 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:09:28 user nova-compute[74241]: </disk>
Oct 20 12:09:28 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:09:28 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:09:29 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:09:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 12:09:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:09:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:09:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:09:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:09:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:09:48 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 is timed out.
Oct 20 12:09:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully detached device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the live domain config.
Oct 20 12:09:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:09:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUJoEIwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:09:48 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:09:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:09:48 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:09:48 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5a8227-0691-4480-a2dd-56bde7953c79]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:09:49 user nova-compute[74241]: No targets found.
Oct 20 12:09:49 user nova-compute[74241]: iSNS:
Oct 20 12:09:49 user nova-compute[74241]: No targets found.
Oct 20 12:09:49 user nova-compute[74241]: STATIC:
Oct 20 12:09:49 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072
Oct 20 12:09:49 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:09:49 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:09:49 user nova-compute[74241]: FIRMWARE:
Oct 20 12:09:49 user nova-compute[74241]: No targets found.
Oct 20 12:09:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:09:49 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:09:49 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16d0e6-6afa-4155-9043-8f465166d144]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7ca2a1-4978-4dce-9925-aba4e579c11a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 (non-flash)
Oct 20 12:09:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 (non-flash)
Oct 20 12:09:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52085451b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6115e253-0f1a-489c-9f80-1bd2a49563e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7697e32b-7a1c-41b6-b1db-b10b66cbf87f]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5249f4f-e7a6-4d01-b1ca-8e81b489aad9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[99de4e24-a93e-48d5-8b05-ac95c3d28006]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99e763b-57ab-47a8-8bf4-3b7fde58f275]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e814e293-3fba-4600-8949-5441757cedbf]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072, portal: 172.16.0.220,3260]
Oct 20 12:09:49 user nova-compute[74241]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072, portal: 172.16.0.220,3260] successful.
Oct 20 12:09:49 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d98c422-18d7-43d8-9032-a9b8adb1c072 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7ccfeb-d2d8-4f9b-9f69-39273aa69706]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== disconnect_volume: return (272ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:09:49 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:09:50 user nova-compute[74241]: DEBUG nova.objects.instance [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:09:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-814657a4-4bd8-4c78-90e2-8ba795f1a0b7 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.769s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:09:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:09:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:09:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:09:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:09:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:09:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:09:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:10:09 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "48613baf-40b5-4648-a8af-6d96ab7a245b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:12 user nova-compute[74241]: INFO nova.compute.manager [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Terminating instance
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.compute.manager [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-2ef4ea2a-ce98-4f11-b8d0-5d23f3afaa6a req-9d8b17f6-3795-4940-ab86-dbe866085e86 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received event network-vif-unplugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2ef4ea2a-ce98-4f11-b8d0-5d23f3afaa6a req-9d8b17f6-3795-4940-ab86-dbe866085e86 service nova] Acquiring lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2ef4ea2a-ce98-4f11-b8d0-5d23f3afaa6a req-9d8b17f6-3795-4940-ab86-dbe866085e86 service nova] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2ef4ea2a-ce98-4f11-b8d0-5d23f3afaa6a req-9d8b17f6-3795-4940-ab86-dbe866085e86 service nova] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-2ef4ea2a-ce98-4f11-b8d0-5d23f3afaa6a req-9d8b17f6-3795-4940-ab86-dbe866085e86 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] No waiting events found dispatching network-vif-unplugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.compute.manager [req-2ef4ea2a-ce98-4f11-b8d0-5d23f3afaa6a req-9d8b17f6-3795-4940-ab86-dbe866085e86 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received event network-vif-unplugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Instance destroyed successfully.
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.objects.instance [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lazy-loading 'resources' on Instance uuid 48613baf-40b5-4648-a8af-6d96ab7a245b {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T11:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1395882665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1395882665',id=28,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T11:49:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52f8151a0cf44b2d89838da474c2dc68',ramdisk_id='',reservation_id='r-1na0vs1y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-929360393',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T11:51:39Z,user_data=None,user_id='0c611c28a9264820a26f203045040420',uuid=48613baf-40b5-4648-a8af-6d96ab7a245b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converting VIF {"id": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "address": "fa:16:3e:34:95:ca", "network": {"id": "fe30b62c-5db9-402e-a131-1920378cb77a", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-342930656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52f8151a0cf44b2d89838da474c2dc68", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap06b4f3fe-70", "ovs_interfaceid": "06b4f3fe-703a-46a2-97e9-b645662f3a0f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:95:ca,bridge_name='br-int',has_traffic_filtering=True,id=06b4f3fe-703a-46a2-97e9-b645662f3a0f,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b4f3fe-70') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG os_vif [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:95:ca,bridge_name='br-int',has_traffic_filtering=True,id=06b4f3fe-703a-46a2-97e9-b645662f3a0f,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b4f3fe-70') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap06b4f3fe-70, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7eec182f-96db-47f4-a665-e14dcf1156fb) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:10:12 user nova-compute[74241]: INFO os_vif [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:95:ca,bridge_name='br-int',has_traffic_filtering=True,id=06b4f3fe-703a-46a2-97e9-b645662f3a0f,network=Network(fe30b62c-5db9-402e-a131-1920378cb77a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap06b4f3fe-70')
Oct 20 12:10:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Deleting instance files /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b_del
Oct 20 12:10:12 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Deletion of /opt/stack/data/nova/instances/48613baf-40b5-4648-a8af-6d96ab7a245b_del complete
Oct 20 12:10:12 user nova-compute[74241]: INFO nova.compute.manager [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 20 12:10:12 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:10:12 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:10:13 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:10:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-9aac3b1b-bd02-4952-b8a9-393ff12915dd req-87d9a363-12a6-47b5-82a6-0132d5c74361 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received event network-vif-deleted-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:10:13 user nova-compute[74241]: INFO nova.compute.manager [req-9aac3b1b-bd02-4952-b8a9-393ff12915dd req-87d9a363-12a6-47b5-82a6-0132d5c74361 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Neutron deleted interface 06b4f3fe-703a-46a2-97e9-b645662f3a0f; detaching it from the instance and deleting it from the info cache
Oct 20 12:10:13 user nova-compute[74241]: DEBUG nova.network.neutron [req-9aac3b1b-bd02-4952-b8a9-393ff12915dd req-87d9a363-12a6-47b5-82a6-0132d5c74361 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:10:13 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Took 0.70 seconds to deallocate network for instance.
Oct 20 12:10:13 user nova-compute[74241]: DEBUG nova.compute.manager [req-9aac3b1b-bd02-4952-b8a9-393ff12915dd req-87d9a363-12a6-47b5-82a6-0132d5c74361 service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Detach interface failed, port_id=06b4f3fe-703a-46a2-97e9-b645662f3a0f, reason: Instance 48613baf-40b5-4648-a8af-6d96ab7a245b could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:10:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:13 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:10:13 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:10:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:13 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Deleted allocations for instance 48613baf-40b5-4648-a8af-6d96ab7a245b
Oct 20 12:10:13 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-fef4c0b8-62f3-4aab-801a-4d339c0021ef tempest-ServerBootFromVolumeStableRescueTest-929360393 tempest-ServerBootFromVolumeStableRescueTest-929360393-project-member] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.749s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-df01dafa-346b-4fe1-8ee4-ac53d414295e req-47bf07aa-ef75-45aa-a753-0914c40adf0f service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received event network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:10:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df01dafa-346b-4fe1-8ee4-ac53d414295e req-47bf07aa-ef75-45aa-a753-0914c40adf0f service nova] Acquiring lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df01dafa-346b-4fe1-8ee4-ac53d414295e req-47bf07aa-ef75-45aa-a753-0914c40adf0f service nova] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:14 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df01dafa-346b-4fe1-8ee4-ac53d414295e req-47bf07aa-ef75-45aa-a753-0914c40adf0f service nova] Lock "48613baf-40b5-4648-a8af-6d96ab7a245b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:14 user nova-compute[74241]: DEBUG nova.compute.manager [req-df01dafa-346b-4fe1-8ee4-ac53d414295e req-47bf07aa-ef75-45aa-a753-0914c40adf0f service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] No waiting events found dispatching network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:10:14 user nova-compute[74241]: WARNING nova.compute.manager [req-df01dafa-346b-4fe1-8ee4-ac53d414295e req-47bf07aa-ef75-45aa-a753-0914c40adf0f service nova] [instance: 48613baf-40b5-4648-a8af-6d96ab7a245b] Received unexpected event network-vif-plugged-06b4f3fe-703a-46a2-97e9-b645662f3a0f for instance with vm_state deleted and task_state None.
Oct 20 12:10:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:16 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:10:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:10:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:10:17 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:10:17 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=25.21329116821289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:10:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:10:21 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:10:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:10:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:10:21 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:10:22 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating instance_info_cache with network_info: [{"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:10:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:10:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:10:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:10:23 user nova-compute[74241]: INFO nova.compute.claims [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Claim successful on node user
Oct 20 12:10:23 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:23 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:10:24 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:10:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG nova.policy [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf5346976b7f45e1b146911555f458eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6744161987c43408e35c847ec2055a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:10:24 user nova-compute[74241]: INFO nova.virt.block_device [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Booting with volume 3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b at /dev/vda
Oct 20 12:10:24 user nova-compute[74241]: DEBUG os_brick.utils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a218a-ec3c-4d74-ba16-a838dd169159]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff2e42b-2b5d-4a5a-95b6-45c64bf217d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e8daf-5ffb-4cd0-9a39-de165354e20a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd9e53-1fc5-409b-bb5e-5530c6cf15db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:10:24 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[80084ca7-e9e7-4fce-bddf-3501de37184e]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG os_brick.utils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Updating existing volume attachment record: bc546273-4b4a-4888-bf4b-8199220b6383 {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Successfully created port: 038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Successfully updated port: 038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquired lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-781eb815-0de2-4d07-b4bd-edbfe86ace52 req-d0262e52-5488-4461-83e4-776f2dde5a1e service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received event network-changed-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-781eb815-0de2-4d07-b4bd-edbfe86ace52 req-d0262e52-5488-4461-83e4-776f2dde5a1e service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Refreshing instance network info cache due to event network-changed-038fc226-f234-4fb9-8c90-23b5ede63dc5. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-781eb815-0de2-4d07-b4bd-edbfe86ace52 req-d0262e52-5488-4461-83e4-776f2dde5a1e service nova] Acquiring lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Updating instance_info_cache with network_info: [{"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Releasing lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Instance network_info: |[{"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-781eb815-0de2-4d07-b4bd-edbfe86ace52 req-d0262e52-5488-4461-83e4-776f2dde5a1e service nova] Acquired lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:10:25 user nova-compute[74241]: DEBUG nova.network.neutron [req-781eb815-0de2-4d07-b4bd-edbfe86ace52 req-d0262e52-5488-4461-83e4-776f2dde5a1e service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Refreshing network info cache for port 038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG nova.network.neutron [req-781eb815-0de2-4d07-b4bd-edbfe86ace52 req-d0262e52-5488-4461-83e4-776f2dde5a1e service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Updated VIF entry in instance network info cache for port 038fc226-f234-4fb9-8c90-23b5ede63dc5. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG nova.network.neutron [req-781eb815-0de2-4d07-b4bd-edbfe86ace52 req-d0262e52-5488-4461-83e4-776f2dde5a1e service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Updating instance_info_cache with network_info: [{"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-781eb815-0de2-4d07-b4bd-edbfe86ace52 req-d0262e52-5488-4461-83e4-776f2dde5a1e service nova] Releasing lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:26 user nova-compute[74241]: WARNING nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Oct 20 12:10:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Triggering sync for uuid bfc3f826-a747-4258-83e4-b1ae064d1d6c {{(pid=74241) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:28 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:10:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:10:29 user nova-compute[74241]: INFO nova.compute.manager [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attaching volume 9cbeb792-730b-42dd-8922-306ad7c3d962 to /dev/vdb
Oct 20 12:10:29 user nova-compute[74241]: DEBUG os_brick.utils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b57ee9f-d8f8-49b0-a19d-706c84cf95d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ac62fa-8aae-4346-8ec2-22d491411511]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[397040d6-1834-4b4e-a01d-0bb8401b1aa4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[461a0d14-655c-4d90-8098-d409d6887cb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:10:29 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:10:29 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf81f19-5db2-4e1e-aab0-c62f9a2f040a]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG os_brick.utils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:10:29 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating existing volume attachment record: b026796f-bad1-4404-8058-232bd34164fa {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:10:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:10:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:10:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZGIryOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:11:00 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:11:00 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:11:00 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef45993-2e4e-4ca9-a897-6105286ee362]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:11:00 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[040fcec8-b37d-4072-ba05-0f7b80595923]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962] added
Oct 20 12:11:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7557d7-c98b-47d0-bc79-90c96365e177]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc25fd16-8d29-46c2-8099-31cd44f9ca1f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZGIryOK {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZGIryOK" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa2b62-f3a2-4851-93e4-086626e592c8]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eZGIryOK'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:11:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Creating image(s)
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Ensure instance console log exists: /opt/stack/data/nova/instances/bfc3f826-a747-4258-83e4-b1ae064d1d6c/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Start _get_guest_xml network_info=[{"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'bc546273-4b4a-4888-bf4b-8199220b6383', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhLoSmZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bfc3f826-a747-4258-83e4-b1ae064d1d6c', 'attached_at': '', 'detached_at': '', 'volume_id': '3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'serial': '3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c106927-01eb-4bad-9422-19bf51e999b0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:11:00 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhLoSmZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:11:00 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a7b416-04e9-44ad-b1e6-4af4a1340c2c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 12:11:00 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 12:11:00 user nova-compute[74241]:  {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:11:00 user nova-compute[74241]: WARNING os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 12:11:00 user nova-compute[74241]: 
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97da57e-4ac3-4f9b-b591-cb86102dfb73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962, portal: 172.16.0.220,3260]
Oct 20 12:11:00 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962, portal: 172.16.0.220,3260] successful.
Oct 20 12:11:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[46074165-80cb-43b6-9a62-ffd9a0876c33]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6f4320-d5b2-446a-b371-2cda5d4dde45]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)
Oct 20 12:11:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)
Oct 20 12:11:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0b817e-c72f-4870-80e8-eb0e485e035e]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:11:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZGIryOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26136336538313031', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136336538313031', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.132s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:11:01 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:11:01 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG nova.objects.instance [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e208fe92-9a0e-458e-8f47-40b115cc393d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:11:01 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 12:11:01 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:11:01 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:11:01 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:11:01 user nova-compute[74241]:   <serial>9cbeb792-730b-42dd-8922-306ad7c3d962</serial>
Oct 20 12:11:01 user nova-compute[74241]: </disk>
Oct 20 12:11:01 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea40e42-77ac-497d-802d-6fcffa595f4a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b] added
Oct 20 12:11:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b3bbf2-a8e5-4433-90ed-d95eb98419a9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d38be1-7625-436e-9f97-b9dda7626f95]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhLoSmZY {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhLoSmZY" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9877a8c8-f370-4211-ad06-a3172b2fc2cd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AhLoSmZY'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d9c0d0-59bb-41aa-8afe-5a6c57a051e2]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba68bf3a-e8d6-499f-927a-fb5e38ca0a62]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)
Oct 20 12:11:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)
Oct 20 12:11:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aa5b3b-e589-47f9-92c9-708d1b838123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260]
Oct 20 12:11:01 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260] successful.
Oct 20 12:11:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa61363-01b6-4518-aaf6-fa8e0d49ad7e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[736bf656-8fb0-4bc3-92ff-276ed2a7c471]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)
Oct 20 12:11:01 user nova-compute[74241]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:11:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)
Oct 20 12:11:01 user nova-compute[74241]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:11:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcc75ca-4fcc-420e-b62e-12fbde0346c9]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhLoSmZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] No VIF found with MAC fa:16:3e:61:a2:5a, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:11:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-c49d44fa-74c8-4735-a477-63ebab7eff5a tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.902s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== connect_volume: return (2431ms) {'type': 'block', 'scsi_wwn': '23333656266666630', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333656266666630', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2088933095',display_name='tempest-TestVolumeBootPattern-server-2088933095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2088933095',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-4dd20gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:10:24Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=bfc3f826-a747-4258-83e4-b1ae064d1d6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:57:f3,bridge_name='br-int',has_traffic_filtering=True,id=038fc226-f234-4fb9-8c90-23b5ede63dc5,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fc226-f2') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'pci_devices' on Instance uuid bfc3f826-a747-4258-83e4-b1ae064d1d6c {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:11:02 user nova-compute[74241]:   <uuid>bfc3f826-a747-4258-83e4-b1ae064d1d6c</uuid>
Oct 20 12:11:02 user nova-compute[74241]:   <name>instance-0000002f</name>
Oct 20 12:11:02 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:11:02 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:11:02 user nova-compute[74241]:   <metadata>
Oct 20 12:11:02 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:11:02 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:11:02 user nova-compute[74241]:       <nova:name>tempest-TestVolumeBootPattern-server-2088933095</nova:name>
Oct 20 12:11:02 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:11:00</nova:creationTime>
Oct 20 12:11:02 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:11:02 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:11:02 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:11:02 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:11:02 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:11:02 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:11:02 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:11:02 user nova-compute[74241]:       <nova:owner>
Oct 20 12:11:02 user nova-compute[74241]:         <nova:user uuid="bf5346976b7f45e1b146911555f458eb">tempest-TestVolumeBootPattern-71867186-project-member</nova:user>
Oct 20 12:11:02 user nova-compute[74241]:         <nova:project uuid="e6744161987c43408e35c847ec2055a5">tempest-TestVolumeBootPattern-71867186</nova:project>
Oct 20 12:11:02 user nova-compute[74241]:       </nova:owner>
Oct 20 12:11:02 user nova-compute[74241]:       <nova:ports>
Oct 20 12:11:02 user nova-compute[74241]:         <nova:port uuid="038fc226-f234-4fb9-8c90-23b5ede63dc5">
Oct 20 12:11:02 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 12:11:02 user nova-compute[74241]:         </nova:port>
Oct 20 12:11:02 user nova-compute[74241]:       </nova:ports>
Oct 20 12:11:02 user nova-compute[74241]:     </nova:instance>
Oct 20 12:11:02 user nova-compute[74241]:   </metadata>
Oct 20 12:11:02 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:11:02 user nova-compute[74241]:     <system>
Oct 20 12:11:02 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:11:02 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:11:02 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:11:02 user nova-compute[74241]:       <entry name="serial">bfc3f826-a747-4258-83e4-b1ae064d1d6c</entry>
Oct 20 12:11:02 user nova-compute[74241]:       <entry name="uuid">bfc3f826-a747-4258-83e4-b1ae064d1d6c</entry>
Oct 20 12:11:02 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:11:02 user nova-compute[74241]:     </system>
Oct 20 12:11:02 user nova-compute[74241]:   </sysinfo>
Oct 20 12:11:02 user nova-compute[74241]:   <os>
Oct 20 12:11:02 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:11:02 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:11:02 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:11:02 user nova-compute[74241]:   </os>
Oct 20 12:11:02 user nova-compute[74241]:   <features>
Oct 20 12:11:02 user nova-compute[74241]:     <acpi/>
Oct 20 12:11:02 user nova-compute[74241]:     <apic/>
Oct 20 12:11:02 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:11:02 user nova-compute[74241]:   </features>
Oct 20 12:11:02 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:11:02 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:11:02 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:11:02 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:11:02 user nova-compute[74241]:   </clock>
Oct 20 12:11:02 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:11:02 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:11:02 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:11:02 user nova-compute[74241]:   </cpu>
Oct 20 12:11:02 user nova-compute[74241]:   <devices>
Oct 20 12:11:02 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:11:02 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:11:02 user nova-compute[74241]:       <source dev="/dev/sdc"/>
Oct 20 12:11:02 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:11:02 user nova-compute[74241]:       <serial>3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b</serial>
Oct 20 12:11:02 user nova-compute[74241]:     </disk>
Oct 20 12:11:02 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:11:02 user nova-compute[74241]:       <mac address="fa:16:3e:8a:57:f3"/>
Oct 20 12:11:02 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:11:02 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:11:02 user nova-compute[74241]:       <target dev="tap038fc226-f2"/>
Oct 20 12:11:02 user nova-compute[74241]:     </interface>
Oct 20 12:11:02 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:11:02 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/bfc3f826-a747-4258-83e4-b1ae064d1d6c/console.log" append="off"/>
Oct 20 12:11:02 user nova-compute[74241]:     </serial>
Oct 20 12:11:02 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:11:02 user nova-compute[74241]:     <video>
Oct 20 12:11:02 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:11:02 user nova-compute[74241]:     </video>
Oct 20 12:11:02 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:11:02 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:11:02 user nova-compute[74241]:     </rng>
Oct 20 12:11:02 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:11:02 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:11:02 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:11:02 user nova-compute[74241]:     </memballoon>
Oct 20 12:11:02 user nova-compute[74241]:   </devices>
Oct 20 12:11:02 user nova-compute[74241]: </domain>
Oct 20 12:11:02 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2088933095',display_name='tempest-TestVolumeBootPattern-server-2088933095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2088933095',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-4dd20gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:10:24Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=bfc3f826-a747-4258-83e4-b1ae064d1d6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:57:f3,bridge_name='br-int',has_traffic_filtering=True,id=038fc226-f234-4fb9-8c90-23b5ede63dc5,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fc226-f2') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG os_vif [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:57:f3,bridge_name='br-int',has_traffic_filtering=True,id=038fc226-f234-4fb9-8c90-23b5ede63dc5,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fc226-f2') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36373220-c702-597d-ae5a-e72b908a1418', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap038fc226-f2, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap038fc226-f2, col_values=(('qos', UUID('4c2e731e-feae-47f7-b632-c2b811c3f15d')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap038fc226-f2, col_values=(('external_ids', {'iface-id': '038fc226-f234-4fb9-8c90-23b5ede63dc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:57:f3', 'vm-uuid': 'bfc3f826-a747-4258-83e4-b1ae064d1d6c'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:02 user nova-compute[74241]: INFO os_vif [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:57:f3,bridge_name='br-int',has_traffic_filtering=True,id=038fc226-f234-4fb9-8c90-23b5ede63dc5,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fc226-f2')
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:11:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No VIF found with MAC fa:16:3e:8a:57:f3, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:11:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:04 user nova-compute[74241]: INFO nova.compute.manager [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Detaching volume 9cbeb792-730b-42dd-8922-306ad7c3d962
Oct 20 12:11:04 user nova-compute[74241]: INFO nova.virt.block_device [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Attempting to driver detach volume 9cbeb792-730b-42dd-8922-306ad7c3d962 from mountpoint /dev/vdb
Oct 20 12:11:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Attempting to detach device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:11:04 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:11:04 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:11:04 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:11:04 user nova-compute[74241]:   <serial>9cbeb792-730b-42dd-8922-306ad7c3d962</serial>
Oct 20 12:11:04 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:11:04 user nova-compute[74241]: </disk>
Oct 20 12:11:04 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:11:04 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully detached device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the persistent domain config.
Oct 20 12:11:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:11:04 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:11:04 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:11:04 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:11:04 user nova-compute[74241]:   <serial>9cbeb792-730b-42dd-8922-306ad7c3d962</serial>
Oct 20 12:11:04 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:11:04 user nova-compute[74241]: </disk>
Oct 20 12:11:04 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-bd7a0679-4b8e-41c3-947f-99f80c4573c2 req-8968b019-1a41-4ea0-ac61-848b71606bcd service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received event network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bd7a0679-4b8e-41c3-947f-99f80c4573c2 req-8968b019-1a41-4ea0-ac61-848b71606bcd service nova] Acquiring lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bd7a0679-4b8e-41c3-947f-99f80c4573c2 req-8968b019-1a41-4ea0-ac61-848b71606bcd service nova] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bd7a0679-4b8e-41c3-947f-99f80c4573c2 req-8968b019-1a41-4ea0-ac61-848b71606bcd service nova] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG nova.compute.manager [req-bd7a0679-4b8e-41c3-947f-99f80c4573c2 req-8968b019-1a41-4ea0-ac61-848b71606bcd service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] No waiting events found dispatching network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:11:04 user nova-compute[74241]: WARNING nova.compute.manager [req-bd7a0679-4b8e-41c3-947f-99f80c4573c2 req-8968b019-1a41-4ea0-ac61-848b71606bcd service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received unexpected event network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 for instance with vm_state building and task_state spawning.
Oct 20 12:11:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:05 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:11:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:11:06 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Instance spawned successfully.
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:06 user nova-compute[74241]: INFO nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Took 6.36 seconds to spawn the instance on the hypervisor.
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:11:06 user nova-compute[74241]: INFO nova.compute.manager [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Took 43.02 seconds to build instance.
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-489425d7-825a-4d3f-8b73-cd668d291e00 req-5ba693ea-5ce7-47a8-a6fe-f63d5a52bcb9 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received event network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-489425d7-825a-4d3f-8b73-cd668d291e00 req-5ba693ea-5ce7-47a8-a6fe-f63d5a52bcb9 service nova] Acquiring lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-489425d7-825a-4d3f-8b73-cd668d291e00 req-5ba693ea-5ce7-47a8-a6fe-f63d5a52bcb9 service nova] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-489425d7-825a-4d3f-8b73-cd668d291e00 req-5ba693ea-5ce7-47a8-a6fe-f63d5a52bcb9 service nova] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG nova.compute.manager [req-489425d7-825a-4d3f-8b73-cd668d291e00 req-5ba693ea-5ce7-47a8-a6fe-f63d5a52bcb9 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] No waiting events found dispatching network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:11:06 user nova-compute[74241]: WARNING nova.compute.manager [req-489425d7-825a-4d3f-8b73-cd668d291e00 req-5ba693ea-5ce7-47a8-a6fe-f63d5a52bcb9 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received unexpected event network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 for instance with vm_state active and task_state None.
Oct 20 12:11:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6246645f-fe59-4123-823b-d407bc201ded tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.127s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 39.930s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:06 user nova-compute[74241]: INFO nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 20 12:11:06 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:11:16 user nova-compute[74241]: INFO nova.compute.claims [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Claim successful on node user
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:11:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.policy [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5402b24624c44ae88239677c5778850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3600c43897b483fb6ed35091763bc01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:11:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Creating image(s)
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk 1073741824" returned: 0 in 0.084s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Successfully created port: 1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Cannot resize image /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Ensure instance console log exists: /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Successfully updated port: 1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-bf2ef3e9-4294-47d0-8450-bafe24c985b5 req-70aebca7-52b9-4967-8a60-52317d94e533 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-changed-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-bf2ef3e9-4294-47d0-8450-bafe24c985b5 req-70aebca7-52b9-4967-8a60-52317d94e533 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Refreshing instance network info cache due to event network-changed-1e5abd04-e0a2-45d3-b060-3a3698250e7a. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bf2ef3e9-4294-47d0-8450-bafe24c985b5 req-70aebca7-52b9-4967-8a60-52317d94e533 service nova] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance network_info: |[{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bf2ef3e9-4294-47d0-8450-bafe24c985b5 req-70aebca7-52b9-4967-8a60-52317d94e533 service nova] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-bf2ef3e9-4294-47d0-8450-bafe24c985b5 req-70aebca7-52b9-4967-8a60-52317d94e533 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Refreshing network info cache for port 1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Start _get_guest_xml network_info=[{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:11:18 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:11:18 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714880826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714880826',id=48,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAg8zolpwnYuhbipksullvjxavUppQCzJmI7GxZvSyqVFkY6dDfsYAFmkEPJENJugHLEct0USovu2bJ1naza0TqerrEcrTWowvI3fj63Qx1MmPy31UqKbey2qGdXeSlZA==',key_name='tempest-keypair-936351467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ja2tzwwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.objects.instance [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'pci_devices' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:11:18 user nova-compute[74241]:   <uuid>e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2</uuid>
Oct 20 12:11:18 user nova-compute[74241]:   <name>instance-00000030</name>
Oct 20 12:11:18 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:11:18 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:11:18 user nova-compute[74241]:   <metadata>
Oct 20 12:11:18 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:11:18 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:11:18 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1714880826</nova:name>
Oct 20 12:11:18 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:11:18</nova:creationTime>
Oct 20 12:11:18 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:11:18 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:11:18 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:11:18 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:11:18 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:11:18 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:11:18 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:11:18 user nova-compute[74241]:       <nova:owner>
Oct 20 12:11:18 user nova-compute[74241]:         <nova:user uuid="a5402b24624c44ae88239677c5778850">tempest-AttachVolumeShelveTestJSON-882980696-project-member</nova:user>
Oct 20 12:11:18 user nova-compute[74241]:         <nova:project uuid="f3600c43897b483fb6ed35091763bc01">tempest-AttachVolumeShelveTestJSON-882980696</nova:project>
Oct 20 12:11:18 user nova-compute[74241]:       </nova:owner>
Oct 20 12:11:18 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 12:11:18 user nova-compute[74241]:       <nova:ports>
Oct 20 12:11:18 user nova-compute[74241]:         <nova:port uuid="1e5abd04-e0a2-45d3-b060-3a3698250e7a">
Oct 20 12:11:18 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 12:11:18 user nova-compute[74241]:         </nova:port>
Oct 20 12:11:18 user nova-compute[74241]:       </nova:ports>
Oct 20 12:11:18 user nova-compute[74241]:     </nova:instance>
Oct 20 12:11:18 user nova-compute[74241]:   </metadata>
Oct 20 12:11:18 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:11:18 user nova-compute[74241]:     <system>
Oct 20 12:11:18 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:11:18 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:11:18 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:11:18 user nova-compute[74241]:       <entry name="serial">e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2</entry>
Oct 20 12:11:18 user nova-compute[74241]:       <entry name="uuid">e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2</entry>
Oct 20 12:11:18 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:11:18 user nova-compute[74241]:     </system>
Oct 20 12:11:18 user nova-compute[74241]:   </sysinfo>
Oct 20 12:11:18 user nova-compute[74241]:   <os>
Oct 20 12:11:18 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:11:18 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:11:18 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:11:18 user nova-compute[74241]:   </os>
Oct 20 12:11:18 user nova-compute[74241]:   <features>
Oct 20 12:11:18 user nova-compute[74241]:     <acpi/>
Oct 20 12:11:18 user nova-compute[74241]:     <apic/>
Oct 20 12:11:18 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:11:18 user nova-compute[74241]:   </features>
Oct 20 12:11:18 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:11:18 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:11:18 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:11:18 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:11:18 user nova-compute[74241]:   </clock>
Oct 20 12:11:18 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:11:18 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:11:18 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:11:18 user nova-compute[74241]:   </cpu>
Oct 20 12:11:18 user nova-compute[74241]:   <devices>
Oct 20 12:11:18 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:11:18 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:11:18 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk"/>
Oct 20 12:11:18 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:11:18 user nova-compute[74241]:     </disk>
Oct 20 12:11:18 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:11:18 user nova-compute[74241]:       <mac address="fa:16:3e:3f:47:e0"/>
Oct 20 12:11:18 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:11:18 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:11:18 user nova-compute[74241]:       <target dev="tap1e5abd04-e0"/>
Oct 20 12:11:18 user nova-compute[74241]:     </interface>
Oct 20 12:11:18 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:11:18 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/console.log" append="off"/>
Oct 20 12:11:18 user nova-compute[74241]:     </serial>
Oct 20 12:11:18 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:11:18 user nova-compute[74241]:     <video>
Oct 20 12:11:18 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:11:18 user nova-compute[74241]:     </video>
Oct 20 12:11:18 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:11:18 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:11:18 user nova-compute[74241]:     </rng>
Oct 20 12:11:18 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:11:18 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:11:18 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:11:18 user nova-compute[74241]:     </memballoon>
Oct 20 12:11:18 user nova-compute[74241]:   </devices>
Oct 20 12:11:18 user nova-compute[74241]: </domain>
Oct 20 12:11:18 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714880826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714880826',id=48,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAg8zolpwnYuhbipksullvjxavUppQCzJmI7GxZvSyqVFkY6dDfsYAFmkEPJENJugHLEct0USovu2bJ1naza0TqerrEcrTWowvI3fj63Qx1MmPy31UqKbey2qGdXeSlZA==',key_name='tempest-keypair-936351467',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ja2tzwwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG os_vif [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66c83001-c4e0-5b2f-8e28-1be2aca47a54', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e5abd04-e0, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e5abd04-e0, col_values=(('qos', UUID('159085f4-daf6-4804-8cb0-2bf2330df71b')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e5abd04-e0, col_values=(('external_ids', {'iface-id': '1e5abd04-e0a2-45d3-b060-3a3698250e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:47:e0', 'vm-uuid': 'e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:18 user nova-compute[74241]: INFO os_vif [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0')
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No VIF found with MAC fa:16:3e:3f:47:e0, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-bf2ef3e9-4294-47d0-8450-bafe24c985b5 req-70aebca7-52b9-4967-8a60-52317d94e533 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updated VIF entry in instance network info cache for port 1e5abd04-e0a2-45d3-b060-3a3698250e7a. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-bf2ef3e9-4294-47d0-8450-bafe24c985b5 req-70aebca7-52b9-4967-8a60-52317d94e533 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:11:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bf2ef3e9-4294-47d0-8450-bafe24c985b5 req-70aebca7-52b9-4967-8a60-52317d94e533 service nova] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:11:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-435c06f4-4770-4346-bc5d-27ca72e4fcc1 req-dc1d4b17-a4bc-43f8-a3b6-ef978803689a service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-435c06f4-4770-4346-bc5d-27ca72e4fcc1 req-dc1d4b17-a4bc-43f8-a3b6-ef978803689a service nova] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-435c06f4-4770-4346-bc5d-27ca72e4fcc1 req-dc1d4b17-a4bc-43f8-a3b6-ef978803689a service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-435c06f4-4770-4346-bc5d-27ca72e4fcc1 req-dc1d4b17-a4bc-43f8-a3b6-ef978803689a service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-435c06f4-4770-4346-bc5d-27ca72e4fcc1 req-dc1d4b17-a4bc-43f8-a3b6-ef978803689a service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] No waiting events found dispatching network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:11:20 user nova-compute[74241]: WARNING nova.compute.manager [req-435c06f4-4770-4346-bc5d-27ca72e4fcc1 req-dc1d4b17-a4bc-43f8-a3b6-ef978803689a service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received unexpected event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a for instance with vm_state building and task_state spawning.
Oct 20 12:11:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.398s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:21 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:11:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:21 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-896afe36-f063-42a3-a466-2018f8779f2b req-5a82b86d-0e1b-4e04-8a94-f786c2cdf446 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-896afe36-f063-42a3-a466-2018f8779f2b req-5a82b86d-0e1b-4e04-8a94-f786c2cdf446 service nova] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-896afe36-f063-42a3-a466-2018f8779f2b req-5a82b86d-0e1b-4e04-8a94-f786c2cdf446 service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-896afe36-f063-42a3-a466-2018f8779f2b req-5a82b86d-0e1b-4e04-8a94-f786c2cdf446 service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-896afe36-f063-42a3-a466-2018f8779f2b req-5a82b86d-0e1b-4e04-8a94-f786c2cdf446 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] No waiting events found dispatching network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:11:22 user nova-compute[74241]: WARNING nova.compute.manager [req-896afe36-f063-42a3-a466-2018f8779f2b req-5a82b86d-0e1b-4e04-8a94-f786c2cdf446 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received unexpected event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a for instance with vm_state building and task_state spawning.
Oct 20 12:11:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:11:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8578MB free_disk=25.209125518798828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:11:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance spawned successfully.
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:11:22 user nova-compute[74241]: INFO nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Took 6.25 seconds to spawn the instance on the hypervisor.
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance bfc3f826-a747-4258-83e4-b1ae064d1d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:11:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:11:23 user nova-compute[74241]: INFO nova.compute.manager [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Took 6.85 seconds to build instance.
Oct 20 12:11:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-8255fad6-d367-4830-bee2-cf15151519af tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.970s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:23 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:11:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:11:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:11:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating instance_info_cache with network_info: [{"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-6867fddf-3915-4ddc-b996-f003a4d46e99" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:25 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 is timed out.
Oct 20 12:11:25 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully detached device vdb from instance 6867fddf-3915-4ddc-b996-f003a4d46e99 from the live domain config.
Oct 20 12:11:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZGIryOK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:11:25 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d571a329-94f0-4d43-8294-850a0d92fe18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:11:25 user nova-compute[74241]: No targets found.
Oct 20 12:11:25 user nova-compute[74241]: iSNS:
Oct 20 12:11:25 user nova-compute[74241]: No targets found.
Oct 20 12:11:25 user nova-compute[74241]: STATIC:
Oct 20 12:11:25 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962
Oct 20 12:11:25 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:11:25 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:11:25 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b
Oct 20 12:11:25 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:11:25 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:11:25 user nova-compute[74241]: FIRMWARE:
Oct 20 12:11:25 user nova-compute[74241]: No targets found.
Oct 20 12:11:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:11:25 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:11:25 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba34b0a-8371-4a3a-bd5a-6dcab9c1ad5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d23404-f132-4be8-8679-62760b1cc2bd]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)
Oct 20 12:11:25 user nova-compute[74241]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:11:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 (non-flash)
Oct 20 12:11:25 user nova-compute[74241]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:11:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52086c3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a2b0e3-30a7-451c-ad7c-d892c7394a28]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[353a95ff-4dd6-4e7e-998a-8478f2e3e628]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d1835f-7ed8-4a87-9d2a-ff3198754f4e]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a130414-8984-44c5-ae31-ff9f28211f21]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[24792af0-86d9-4e7c-8a19-f16067d61d2f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f02844f-7d3d-487f-9017-b43840c35846]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962, portal: 172.16.0.220,3260]
Oct 20 12:11:25 user nova-compute[74241]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962, portal: 172.16.0.220,3260] successful.
Oct 20 12:11:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cbeb792-730b-42dd-8922-306ad7c3d962 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f200257-3da1-4e77-9e3f-b0f2376db5a0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] <== disconnect_volume: return (337ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:11:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:11:26 user nova-compute[74241]: DEBUG nova.objects.instance [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'flavor' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:11:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-5703624e-708e-4921-ba96-20de9b46c9eb tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:11:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:11:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:11:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:11:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:11:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:11:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:11:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:12:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:12:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:12:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:12:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:12:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:12:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:12:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:12:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:12:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:12:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:12:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-712fe1ad-16f3-4206-9fdd-658452894e98 req-0c9eaa91-90d8-4505-97b8-a3f3da41158c service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received event network-changed-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:12:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-712fe1ad-16f3-4206-9fdd-658452894e98 req-0c9eaa91-90d8-4505-97b8-a3f3da41158c service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Refreshing instance network info cache due to event network-changed-038fc226-f234-4fb9-8c90-23b5ede63dc5. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:12:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-712fe1ad-16f3-4206-9fdd-658452894e98 req-0c9eaa91-90d8-4505-97b8-a3f3da41158c service nova] Acquiring lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:12:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-712fe1ad-16f3-4206-9fdd-658452894e98 req-0c9eaa91-90d8-4505-97b8-a3f3da41158c service nova] Acquired lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:12:15 user nova-compute[74241]: DEBUG nova.network.neutron [req-712fe1ad-16f3-4206-9fdd-658452894e98 req-0c9eaa91-90d8-4505-97b8-a3f3da41158c service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Refreshing network info cache for port 038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-712fe1ad-16f3-4206-9fdd-658452894e98 req-0c9eaa91-90d8-4505-97b8-a3f3da41158c service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Updated VIF entry in instance network info cache for port 038fc226-f234-4fb9-8c90-23b5ede63dc5. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG nova.network.neutron [req-712fe1ad-16f3-4206-9fdd-658452894e98 req-0c9eaa91-90d8-4505-97b8-a3f3da41158c service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Updating instance_info_cache with network_info: [{"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-712fe1ad-16f3-4206-9fdd-658452894e98 req-0c9eaa91-90d8-4505-97b8-a3f3da41158c service nova] Releasing lock "refresh_cache-bfc3f826-a747-4258-83e4-b1ae064d1d6c" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:12:16 user nova-compute[74241]: INFO nova.compute.manager [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Terminating instance
Oct 20 12:12:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Instance destroyed successfully.
Oct 20 12:12:16 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'resources' on Instance uuid bfc3f826-a747-4258-83e4-b1ae064d1d6c {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:10:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2088933095',display_name='tempest-TestVolumeBootPattern-server-2088933095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2088933095',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:11:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-4dd20gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:11:07Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=bfc3f826-a747-4258-83e4-b1ae064d1d6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "address": "fa:16:3e:8a:57:f3", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap038fc226-f2", "ovs_interfaceid": "038fc226-f234-4fb9-8c90-23b5ede63dc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:57:f3,bridge_name='br-int',has_traffic_filtering=True,id=038fc226-f234-4fb9-8c90-23b5ede63dc5,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fc226-f2') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG os_vif [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:57:f3,bridge_name='br-int',has_traffic_filtering=True,id=038fc226-f234-4fb9-8c90-23b5ede63dc5,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fc226-f2') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap038fc226-f2, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c2e731e-feae-47f7-b632-c2b811c3f15d) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:12:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:12:17 user nova-compute[74241]: INFO os_vif [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:57:f3,bridge_name='br-int',has_traffic_filtering=True,id=038fc226-f234-4fb9-8c90-23b5ede63dc5,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap038fc226-f2')
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhLoSmZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:12:17 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a762de45-8106-4cc0-a364-1d757cd9309f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:12:17 user nova-compute[74241]: No targets found.
Oct 20 12:12:17 user nova-compute[74241]: iSNS:
Oct 20 12:12:17 user nova-compute[74241]: No targets found.
Oct 20 12:12:17 user nova-compute[74241]: STATIC:
Oct 20 12:12:17 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b
Oct 20 12:12:17 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:12:17 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:12:17 user nova-compute[74241]: FIRMWARE:
Oct 20 12:12:17 user nova-compute[74241]: No targets found.
Oct 20 12:12:17 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:12:17 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:12:17 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9014f09-edf7-4012-9c88-3e3c37351875]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7823e3fd-002e-48d1-87d4-307ea443410f]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:12:17 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:12:17 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52287744c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f96bcd-5c41-436b-bc49-ba7cc0c10a27]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3550b4b9-3de8-4617-94a8-3a99c461f357]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7cd76-21ab-4934-87a0-0b291477b7f8]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb404370-e141-4249-9a6f-9fefa3121bd2]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23333656266666630', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_79ee4281', '/dev/disk/by-id/scsi-1SCST_BIO79ee4281-33ebfff0ce28d58f') {{(pid=85185) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d61f18f-1cd8-4723-91a1-7c041277111a]: (4, None) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a682202-41d3-488b-affa-04bd345738bf]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b9a26-23d5-4165-b262-579369affb98]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260]
Oct 20 12:12:17 user nova-compute[74241]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260] successful.
Oct 20 12:12:17 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[93542883-0143-4c25-b44b-48adbf23eac9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== disconnect_volume: return (310ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:12:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Deleting instance files /opt/stack/data/nova/instances/bfc3f826-a747-4258-83e4-b1ae064d1d6c_del
Oct 20 12:12:17 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Deletion of /opt/stack/data/nova/instances/bfc3f826-a747-4258-83e4-b1ae064d1d6c_del complete
Oct 20 12:12:17 user nova-compute[74241]: INFO nova.compute.manager [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received event network-vif-unplugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] Acquiring lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] No waiting events found dispatching network-vif-unplugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received event network-vif-unplugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received event network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] Acquiring lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] No waiting events found dispatching network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:12:17 user nova-compute[74241]: WARNING nova.compute.manager [req-79c639b1-2ab9-46ab-adba-d7a53eed94e3 req-214fb1ed-8c6c-4024-a41c-c6726806bf52 service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received unexpected event network-vif-plugged-038fc226-f234-4fb9-8c90-23b5ede63dc5 for instance with vm_state active and task_state deleting.
Oct 20 12:12:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:17 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:12:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-54d6fa5b-1502-4199-8799-9a8cf73071ed req-b6d514f7-43b9-43e6-bbd4-3553081b956b service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Received event network-vif-deleted-038fc226-f234-4fb9-8c90-23b5ede63dc5 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:12:18 user nova-compute[74241]: INFO nova.compute.manager [req-54d6fa5b-1502-4199-8799-9a8cf73071ed req-b6d514f7-43b9-43e6-bbd4-3553081b956b service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Neutron deleted interface 038fc226-f234-4fb9-8c90-23b5ede63dc5; detaching it from the instance and deleting it from the info cache
Oct 20 12:12:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-54d6fa5b-1502-4199-8799-9a8cf73071ed req-b6d514f7-43b9-43e6-bbd4-3553081b956b service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:12:18 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Took 0.64 seconds to deallocate network for instance.
Oct 20 12:12:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-54d6fa5b-1502-4199-8799-9a8cf73071ed req-b6d514f7-43b9-43e6-bbd4-3553081b956b service nova] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Detach interface failed, port_id=038fc226-f234-4fb9-8c90-23b5ede63dc5, reason: Instance bfc3f826-a747-4258-83e4-b1ae064d1d6c could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:12:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:18 user nova-compute[74241]: INFO nova.compute.manager [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: bfc3f826-a747-4258-83e4-b1ae064d1d6c] Took 0.82 seconds to detach 1 volumes for instance.
Oct 20 12:12:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:12:19 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Deleted allocations for instance bfc3f826-a747-4258-83e4-b1ae064d1d6c
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8d0f3a5-5446-4245-b36e-b0a44a5b4b07 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "bfc3f826-a747-4258-83e4-b1ae064d1d6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.052s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:19 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:12:20 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:12:20 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:12:20 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=25.17147445678711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 6867fddf-3915-4ddc-b996-f003a4d46e99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:12:20 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:12:21 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:12:21 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:12:21 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:12:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:12:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:12:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:12:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:12:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:12:22 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:12:23 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:12:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:12:23 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:12:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:12:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:12:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:12:59 user nova-compute[74241]: INFO nova.compute.manager [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Terminating instance
Oct 20 12:12:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:12:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-04849bf2-9490-4438-9b3f-2c0c86f48d94 req-c3401c0f-b8e7-4859-91a9-76c7348f6dad service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-unplugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-04849bf2-9490-4438-9b3f-2c0c86f48d94 req-c3401c0f-b8e7-4859-91a9-76c7348f6dad service nova] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-04849bf2-9490-4438-9b3f-2c0c86f48d94 req-c3401c0f-b8e7-4859-91a9-76c7348f6dad service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-04849bf2-9490-4438-9b3f-2c0c86f48d94 req-c3401c0f-b8e7-4859-91a9-76c7348f6dad service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-04849bf2-9490-4438-9b3f-2c0c86f48d94 req-c3401c0f-b8e7-4859-91a9-76c7348f6dad service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] No waiting events found dispatching network-vif-unplugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-04849bf2-9490-4438-9b3f-2c0c86f48d94 req-c3401c0f-b8e7-4859-91a9-76c7348f6dad service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-unplugged-b0bd4099-0208-462f-bf95-4fde5272d1ff for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Instance destroyed successfully.
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lazy-loading 'resources' on Instance uuid 6867fddf-3915-4ddc-b996-f003a4d46e99 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:03:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-583210467',display_name='tempest-SnapshotDataIntegrityTests-server-583210467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-583210467',id=44,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQqFOs6E6TQq4NT5IgSRLMYBilFYnLRBHhicN9qI0SVH/7xU2VvXW48QSbSi1/QnylqFtTQBT2PvnDZeU0CFjhwj/XpomEt0JLbYBtLGxIvyaQvbTzbLnNATDLZKKnSUQ==',key_name='tempest-keypair-1015062290',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b2aef9fb6c554b21907299e277dad5df',ramdisk_id='',reservation_id='r-ef0iog84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1985280562',owner_user_name='tempest-SnapshotDataIntegrityTests-1985280562-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='922e09d51b734b829920133e2f331f5f',uuid=6867fddf-3915-4ddc-b996-f003a4d46e99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Converting VIF {"id": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "address": "fa:16:3e:61:a2:5a", "network": {"id": "bcc5fc78-7bad-4989-9f5a-d8c16a57a51e", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-919918158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b2aef9fb6c554b21907299e277dad5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0bd4099-02", "ovs_interfaceid": "b0bd4099-0208-462f-bf95-4fde5272d1ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:a2:5a,bridge_name='br-int',has_traffic_filtering=True,id=b0bd4099-0208-462f-bf95-4fde5272d1ff,network=Network(bcc5fc78-7bad-4989-9f5a-d8c16a57a51e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bd4099-02') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG os_vif [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:a2:5a,bridge_name='br-int',has_traffic_filtering=True,id=b0bd4099-0208-462f-bf95-4fde5272d1ff,network=Network(bcc5fc78-7bad-4989-9f5a-d8c16a57a51e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bd4099-02') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0bd4099-02, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3d9eb30-0ce3-48fe-92a6-6e0629357fd3) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:13:00 user nova-compute[74241]: INFO os_vif [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:a2:5a,bridge_name='br-int',has_traffic_filtering=True,id=b0bd4099-0208-462f-bf95-4fde5272d1ff,network=Network(bcc5fc78-7bad-4989-9f5a-d8c16a57a51e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0bd4099-02')
Oct 20 12:13:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Deleting instance files /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99_del
Oct 20 12:13:00 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Deletion of /opt/stack/data/nova/instances/6867fddf-3915-4ddc-b996-f003a4d46e99_del complete
Oct 20 12:13:00 user nova-compute[74241]: INFO nova.compute.manager [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 12:13:00 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:13:00 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:13:01 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Took 0.83 seconds to deallocate network for instance.
Oct 20 12:13:01 user nova-compute[74241]: DEBUG nova.compute.manager [req-7ebe79e4-129a-410a-8edb-4e4ba5980d0f req-4e05068e-f70f-4203-bfe6-dde18828d9af service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-deleted-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:13:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:01 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Deleted allocations for instance 6867fddf-3915-4ddc-b996-f003a4d46e99
Oct 20 12:13:01 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d7077e3b-8032-4905-9a02-49d8cf7a3286 tempest-SnapshotDataIntegrityTests-1985280562 tempest-SnapshotDataIntegrityTests-1985280562-project-member] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.003s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] No waiting events found dispatching network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:02 user nova-compute[74241]: WARNING nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received unexpected event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff for instance with vm_state deleted and task_state None.
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] No waiting events found dispatching network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:02 user nova-compute[74241]: WARNING nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received unexpected event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff for instance with vm_state deleted and task_state None.
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] No waiting events found dispatching network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:02 user nova-compute[74241]: WARNING nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received unexpected event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff for instance with vm_state deleted and task_state None.
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-unplugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] No waiting events found dispatching network-vif-unplugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:02 user nova-compute[74241]: WARNING nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received unexpected event network-vif-unplugged-b0bd4099-0208-462f-bf95-4fde5272d1ff for instance with vm_state deleted and task_state None.
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Acquiring lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] Lock "6867fddf-3915-4ddc-b996-f003a4d46e99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:02 user nova-compute[74241]: DEBUG nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] No waiting events found dispatching network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:02 user nova-compute[74241]: WARNING nova.compute.manager [req-db8f7e6d-2ea1-40fb-a73b-2422274ff5a9 req-1e6df039-1ce6-4253-b10a-9571375d07c1 service nova] [instance: 6867fddf-3915-4ddc-b996-f003a4d46e99] Received unexpected event network-vif-plugged-b0bd4099-0208-462f-bf95-4fde5272d1ff for instance with vm_state deleted and task_state None.
Oct 20 12:13:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-2a6155db-9aaf-4d81-9a39-faec4e844782 req-f401cfb4-c25d-41ba-a751-17dd854422bb service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-changed-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-2a6155db-9aaf-4d81-9a39-faec4e844782 req-f401cfb4-c25d-41ba-a751-17dd854422bb service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Refreshing instance network info cache due to event network-changed-1e5abd04-e0a2-45d3-b060-3a3698250e7a. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2a6155db-9aaf-4d81-9a39-faec4e844782 req-f401cfb4-c25d-41ba-a751-17dd854422bb service nova] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2a6155db-9aaf-4d81-9a39-faec4e844782 req-f401cfb4-c25d-41ba-a751-17dd854422bb service nova] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG nova.network.neutron [req-2a6155db-9aaf-4d81-9a39-faec4e844782 req-f401cfb4-c25d-41ba-a751-17dd854422bb service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Refreshing network info cache for port 1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG nova.network.neutron [req-2a6155db-9aaf-4d81-9a39-faec4e844782 req-f401cfb4-c25d-41ba-a751-17dd854422bb service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updated VIF entry in instance network info cache for port 1e5abd04-e0a2-45d3-b060-3a3698250e7a. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG nova.network.neutron [req-2a6155db-9aaf-4d81-9a39-faec4e844782 req-f401cfb4-c25d-41ba-a751-17dd854422bb service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2a6155db-9aaf-4d81-9a39-faec4e844782 req-f401cfb4-c25d-41ba-a751-17dd854422bb service nova] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "3852f29a-2048-49b5-a381-2fba26f56bc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:07 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:13:07 user nova-compute[74241]: INFO nova.compute.claims [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Claim successful on node user
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:13:08 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.policy [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf5346976b7f45e1b146911555f458eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6744161987c43408e35c847ec2055a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:13:08 user nova-compute[74241]: INFO nova.virt.block_device [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Booting with volume 3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b at /dev/vda
Oct 20 12:13:08 user nova-compute[74241]: DEBUG os_brick.utils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c50ccb-a068-4d2b-8916-8b02893288be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[299c66e5-465a-4754-b5d7-d17d5f0747c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d618de-1365-4ba4-9a87-6b797026e7d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d49a052-3f2d-460f-9c1e-d2f45a40fbfc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:13:08 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:13:08 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06e612c-2a80-456b-a0ac-e613439ff4f2]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG os_brick.utils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating existing volume attachment record: a3adc9b7-011d-4d99-8fef-91c0577c337f {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:13:08 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Successfully created port: b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Successfully updated port: b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquired lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-39030845-3810-47d9-a823-ca8a5cb0fbba req-1886f4a3-cdf5-48f0-b816-94548ea96625 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-changed-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-39030845-3810-47d9-a823-ca8a5cb0fbba req-1886f4a3-cdf5-48f0-b816-94548ea96625 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Refreshing instance network info cache due to event network-changed-b4d15b2b-b7d8-492a-822b-63074d420ac9. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39030845-3810-47d9-a823-ca8a5cb0fbba req-1886f4a3-cdf5-48f0-b816-94548ea96625 service nova] Acquiring lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG nova.network.neutron [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Releasing lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Instance network_info: |[{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39030845-3810-47d9-a823-ca8a5cb0fbba req-1886f4a3-cdf5-48f0-b816-94548ea96625 service nova] Acquired lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:13:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-39030845-3810-47d9-a823-ca8a5cb0fbba req-1886f4a3-cdf5-48f0-b816-94548ea96625 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Refreshing network info cache for port b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:13:10 user nova-compute[74241]: DEBUG nova.network.neutron [req-39030845-3810-47d9-a823-ca8a5cb0fbba req-1886f4a3-cdf5-48f0-b816-94548ea96625 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updated VIF entry in instance network info cache for port b4d15b2b-b7d8-492a-822b-63074d420ac9. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:13:10 user nova-compute[74241]: DEBUG nova.network.neutron [req-39030845-3810-47d9-a823-ca8a5cb0fbba req-1886f4a3-cdf5-48f0-b816-94548ea96625 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:13:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39030845-3810-47d9-a823-ca8a5cb0fbba req-1886f4a3-cdf5-48f0-b816-94548ea96625 service nova] Releasing lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:13:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:12 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:15 user nova-compute[74241]: INFO nova.compute.manager [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Shelving
Oct 20 12:13:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-df9aa0d4-a3ff-4005-9215-9273c3cf94fd req-f11be5c7-d3d7-42e9-870c-c7a96209d2cc service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-unplugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df9aa0d4-a3ff-4005-9215-9273c3cf94fd req-f11be5c7-d3d7-42e9-870c-c7a96209d2cc service nova] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df9aa0d4-a3ff-4005-9215-9273c3cf94fd req-f11be5c7-d3d7-42e9-870c-c7a96209d2cc service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-df9aa0d4-a3ff-4005-9215-9273c3cf94fd req-f11be5c7-d3d7-42e9-870c-c7a96209d2cc service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:15 user nova-compute[74241]: DEBUG nova.compute.manager [req-df9aa0d4-a3ff-4005-9215-9273c3cf94fd req-f11be5c7-d3d7-42e9-870c-c7a96209d2cc service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] No waiting events found dispatching network-vif-unplugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:15 user nova-compute[74241]: WARNING nova.compute.manager [req-df9aa0d4-a3ff-4005-9215-9273c3cf94fd req-f11be5c7-d3d7-42e9-870c-c7a96209d2cc service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received unexpected event network-vif-unplugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a for instance with vm_state active and task_state shelving.
Oct 20 12:13:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance destroyed successfully.
Oct 20 12:13:15 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Beginning cold snapshot process
Oct 20 12:13:16 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 12:13:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk /opt/stack/data/nova/instances/snapshots/tmpl2w2xxyx/cb5e17a02185420bad757530a6acf5f3 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk /opt/stack/data/nova/instances/snapshots/tmpl2w2xxyx/cb5e17a02185420bad757530a6acf5f3" returned: 0 in 0.625s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Snapshot extracted, beginning image upload
Oct 20 12:13:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-9f4915a9-f41c-43eb-bf90-de0450cae2a8 req-7b5fd6ef-e82e-4fcf-ae54-ddb176bac10d service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9f4915a9-f41c-43eb-bf90-de0450cae2a8 req-7b5fd6ef-e82e-4fcf-ae54-ddb176bac10d service nova] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9f4915a9-f41c-43eb-bf90-de0450cae2a8 req-7b5fd6ef-e82e-4fcf-ae54-ddb176bac10d service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9f4915a9-f41c-43eb-bf90-de0450cae2a8 req-7b5fd6ef-e82e-4fcf-ae54-ddb176bac10d service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-9f4915a9-f41c-43eb-bf90-de0450cae2a8 req-7b5fd6ef-e82e-4fcf-ae54-ddb176bac10d service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] No waiting events found dispatching network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:17 user nova-compute[74241]: WARNING nova.compute.manager [req-9f4915a9-f41c-43eb-bf90-de0450cae2a8 req-7b5fd6ef-e82e-4fcf-ae54-ddb176bac10d service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received unexpected event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 12:13:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:19 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Snapshot image upload complete
Oct 20 12:13:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:13:19 user nova-compute[74241]: INFO nova.compute.manager [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Shelve offloading
Oct 20 12:13:19 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance destroyed successfully.
Oct 20 12:13:19 user nova-compute[74241]: DEBUG nova.compute.manager [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:13:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:13:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:13:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:13:19 user nova-compute[74241]: DEBUG nova.network.neutron [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:13:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:13:20 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance destroyed successfully.
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'resources' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714880826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714880826',id=48,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAg8zolpwnYuhbipksullvjxavUppQCzJmI7GxZvSyqVFkY6dDfsYAFmkEPJENJugHLEct0USovu2bJ1naza0TqerrEcrTWowvI3fj63Qx1MmPy31UqKbey2qGdXeSlZA==',key_name='tempest-keypair-936351467',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ja2tzwwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member',shelved_at='2023-10-20T12:13:19.161738',shelved_host='user',shelved_image_id='1853915e-aa59-4ab8-86dd-1db74d84c7d2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG os_vif [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e5abd04-e0, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-c67b8ff2-82be-4cda-a162-b9f87648882f req-70e1d6ec-3352-4182-a3d4-c877f80043ee service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-changed-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.compute.manager [req-c67b8ff2-82be-4cda-a162-b9f87648882f req-70e1d6ec-3352-4182-a3d4-c877f80043ee service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Refreshing instance network info cache due to event network-changed-1e5abd04-e0a2-45d3-b060-3a3698250e7a. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c67b8ff2-82be-4cda-a162-b9f87648882f req-70e1d6ec-3352-4182-a3d4-c877f80043ee service nova] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c67b8ff2-82be-4cda-a162-b9f87648882f req-70e1d6ec-3352-4182-a3d4-c877f80043ee service nova] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-c67b8ff2-82be-4cda-a162-b9f87648882f req-70e1d6ec-3352-4182-a3d4-c877f80043ee service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Refreshing network info cache for port 1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=159085f4-daf6-4804-8cb0-2bf2330df71b) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:13:20 user nova-compute[74241]: INFO os_vif [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0')
Oct 20 12:13:20 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Deleting instance files /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2_del
Oct 20 12:13:20 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Deletion of /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2_del complete
Oct 20 12:13:20 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Deleted allocations for instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2
Oct 20 12:13:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.objects.instance [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'numa_topology' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.objects.base [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2> lazy-loaded attributes: resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-904c8b07-2a2f-464f-b89a-7184a91bbf54 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.390s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-c67b8ff2-82be-4cda-a162-b9f87648882f req-70e1d6ec-3352-4182-a3d4-c877f80043ee service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updated VIF entry in instance network info cache for port 1e5abd04-e0a2-45d3-b060-3a3698250e7a. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG nova.network.neutron [req-c67b8ff2-82be-4cda-a162-b9f87648882f req-70e1d6ec-3352-4182-a3d4-c877f80043ee service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:13:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c67b8ff2-82be-4cda-a162-b9f87648882f req-70e1d6ec-3352-4182-a3d4-c877f80043ee service nova] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:13:21 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:21 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:21 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:13:21 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:21 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:13:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:13:22 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:13:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=25.176971435546875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3852f29a-2048-49b5-a381-2fba26f56bc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:13:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Skipping network cache update for instance because it is Building. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:13:24 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Creating image(s)
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Ensure instance console log exists: /opt/stack/data/nova/instances/3852f29a-2048-49b5-a381-2fba26f56bc0/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Start _get_guest_xml network_info=[{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'a3adc9b7-011d-4d99-8fef-91c0577c337f', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhLoSmZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3852f29a-2048-49b5-a381-2fba26f56bc0', 'attached_at': '', 'detached_at': '', 'volume_id': '3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'serial': '3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:13:24 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:13:24 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhLoSmZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:13:24 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:13:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:13:24 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:13:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:13:24 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf1dd45-7085-4ab3-aefd-c745c4114269]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:13:24 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be6dab7-21b1-4a8f-ae56-d97694a6c29f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b] added
Oct 20 12:13:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[12704d79-1e7f-40de-a645-29dea3a96d7b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:13:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9321f6a0-73fe-49ac-a01b-a6900f99660a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhLoSmZY {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AhLoSmZY" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b57e39-f8c3-4fa1-b75e-4bbf5f991a52]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AhLoSmZY'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae17cf50-62ef-4fb4-9f23-9e1042f1f860]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64afa12-ca33-40e4-9c90-8d2642436121]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 12:13:25 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 12:13:25 user nova-compute[74241]:  {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:13:25 user nova-compute[74241]: WARNING os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 12:13:25 user nova-compute[74241]: 
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff1b11b-c295-4c12-89a7-6d70e88c45be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260]
Oct 20 12:13:25 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260] successful.
Oct 20 12:13:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a60f7d-b3e9-4da9-9355-31eee40de263]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa970fa3-5666-409c-a966-41492aaed720]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:13:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:13:25 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8c3b92-96e9-4809-ac92-0a1de3e0b3ab]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:13:25 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhLoSmZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23333656266666630', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333656266666630', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:13:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-996765420',display_name='tempest-TestVolumeBootPattern-server-996765420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-996765420',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-6p0cy6lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:13:08Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=3852f29a-2048-49b5-a381-2fba26f56bc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:88:ea,bridge_name='br-int',has_traffic_filtering=True,id=b4d15b2b-b7d8-492a-822b-63074d420ac9,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4d15b2b-b7') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'pci_devices' on Instance uuid 3852f29a-2048-49b5-a381-2fba26f56bc0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:13:26 user nova-compute[74241]:   <uuid>3852f29a-2048-49b5-a381-2fba26f56bc0</uuid>
Oct 20 12:13:26 user nova-compute[74241]:   <name>instance-00000031</name>
Oct 20 12:13:26 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:13:26 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:13:26 user nova-compute[74241]:   <metadata>
Oct 20 12:13:26 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:13:26 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:13:26 user nova-compute[74241]:       <nova:name>tempest-TestVolumeBootPattern-server-996765420</nova:name>
Oct 20 12:13:26 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:13:24</nova:creationTime>
Oct 20 12:13:26 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:13:26 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:13:26 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:13:26 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:13:26 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:13:26 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:13:26 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:13:26 user nova-compute[74241]:       <nova:owner>
Oct 20 12:13:26 user nova-compute[74241]:         <nova:user uuid="bf5346976b7f45e1b146911555f458eb">tempest-TestVolumeBootPattern-71867186-project-member</nova:user>
Oct 20 12:13:26 user nova-compute[74241]:         <nova:project uuid="e6744161987c43408e35c847ec2055a5">tempest-TestVolumeBootPattern-71867186</nova:project>
Oct 20 12:13:26 user nova-compute[74241]:       </nova:owner>
Oct 20 12:13:26 user nova-compute[74241]:       <nova:ports>
Oct 20 12:13:26 user nova-compute[74241]:         <nova:port uuid="b4d15b2b-b7d8-492a-822b-63074d420ac9">
Oct 20 12:13:26 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 12:13:26 user nova-compute[74241]:         </nova:port>
Oct 20 12:13:26 user nova-compute[74241]:       </nova:ports>
Oct 20 12:13:26 user nova-compute[74241]:     </nova:instance>
Oct 20 12:13:26 user nova-compute[74241]:   </metadata>
Oct 20 12:13:26 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:13:26 user nova-compute[74241]:     <system>
Oct 20 12:13:26 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:13:26 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:13:26 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:13:26 user nova-compute[74241]:       <entry name="serial">3852f29a-2048-49b5-a381-2fba26f56bc0</entry>
Oct 20 12:13:26 user nova-compute[74241]:       <entry name="uuid">3852f29a-2048-49b5-a381-2fba26f56bc0</entry>
Oct 20 12:13:26 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:13:26 user nova-compute[74241]:     </system>
Oct 20 12:13:26 user nova-compute[74241]:   </sysinfo>
Oct 20 12:13:26 user nova-compute[74241]:   <os>
Oct 20 12:13:26 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:13:26 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:13:26 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:13:26 user nova-compute[74241]:   </os>
Oct 20 12:13:26 user nova-compute[74241]:   <features>
Oct 20 12:13:26 user nova-compute[74241]:     <acpi/>
Oct 20 12:13:26 user nova-compute[74241]:     <apic/>
Oct 20 12:13:26 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:13:26 user nova-compute[74241]:   </features>
Oct 20 12:13:26 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:13:26 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:13:26 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:13:26 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:13:26 user nova-compute[74241]:   </clock>
Oct 20 12:13:26 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:13:26 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:13:26 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:13:26 user nova-compute[74241]:   </cpu>
Oct 20 12:13:26 user nova-compute[74241]:   <devices>
Oct 20 12:13:26 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:13:26 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:13:26 user nova-compute[74241]:       <source dev="/dev/sdb"/>
Oct 20 12:13:26 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:13:26 user nova-compute[74241]:       <serial>3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b</serial>
Oct 20 12:13:26 user nova-compute[74241]:     </disk>
Oct 20 12:13:26 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:13:26 user nova-compute[74241]:       <mac address="fa:16:3e:ad:88:ea"/>
Oct 20 12:13:26 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:13:26 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:13:26 user nova-compute[74241]:       <target dev="tapb4d15b2b-b7"/>
Oct 20 12:13:26 user nova-compute[74241]:     </interface>
Oct 20 12:13:26 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:13:26 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/3852f29a-2048-49b5-a381-2fba26f56bc0/console.log" append="off"/>
Oct 20 12:13:26 user nova-compute[74241]:     </serial>
Oct 20 12:13:26 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:13:26 user nova-compute[74241]:     <video>
Oct 20 12:13:26 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:13:26 user nova-compute[74241]:     </video>
Oct 20 12:13:26 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:13:26 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:13:26 user nova-compute[74241]:     </rng>
Oct 20 12:13:26 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:13:26 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:13:26 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:13:26 user nova-compute[74241]:     </memballoon>
Oct 20 12:13:26 user nova-compute[74241]:   </devices>
Oct 20 12:13:26 user nova-compute[74241]: </domain>
Oct 20 12:13:26 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:13:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-996765420',display_name='tempest-TestVolumeBootPattern-server-996765420',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-996765420',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-6p0cy6lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:13:08Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=3852f29a-2048-49b5-a381-2fba26f56bc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:88:ea,bridge_name='br-int',has_traffic_filtering=True,id=b4d15b2b-b7d8-492a-822b-63074d420ac9,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4d15b2b-b7') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG os_vif [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:88:ea,bridge_name='br-int',has_traffic_filtering=True,id=b4d15b2b-b7d8-492a-822b-63074d420ac9,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4d15b2b-b7') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64639dc1-2c1a-57c6-a6a2-958b7f9dea0a', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4d15b2b-b7, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4d15b2b-b7, col_values=(('qos', UUID('0ac96c76-0bb4-4765-9a49-92aeb0a38746')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4d15b2b-b7, col_values=(('external_ids', {'iface-id': 'b4d15b2b-b7d8-492a-822b-63074d420ac9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:88:ea', 'vm-uuid': '3852f29a-2048-49b5-a381-2fba26f56bc0'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:26 user nova-compute[74241]: INFO os_vif [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:88:ea,bridge_name='br-int',has_traffic_filtering=True,id=b4d15b2b-b7d8-492a-822b-63074d420ac9,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4d15b2b-b7')
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No VIF found with MAC fa:16:3e:ad:88:ea, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:13:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-88a47dca-e30e-4353-90a7-866d99a339c7 req-29022de9-8c66-4b54-8ff6-0e9d35e03e25 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-88a47dca-e30e-4353-90a7-866d99a339c7 req-29022de9-8c66-4b54-8ff6-0e9d35e03e25 service nova] Acquiring lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-88a47dca-e30e-4353-90a7-866d99a339c7 req-29022de9-8c66-4b54-8ff6-0e9d35e03e25 service nova] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-88a47dca-e30e-4353-90a7-866d99a339c7 req-29022de9-8c66-4b54-8ff6-0e9d35e03e25 service nova] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:27 user nova-compute[74241]: DEBUG nova.compute.manager [req-88a47dca-e30e-4353-90a7-866d99a339c7 req-29022de9-8c66-4b54-8ff6-0e9d35e03e25 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] No waiting events found dispatching network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:27 user nova-compute[74241]: WARNING nova.compute.manager [req-88a47dca-e30e-4353-90a7-866d99a339c7 req-29022de9-8c66-4b54-8ff6-0e9d35e03e25 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received unexpected event network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 for instance with vm_state building and task_state spawning.
Oct 20 12:13:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:13:29 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Instance spawned successfully.
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:13:29 user nova-compute[74241]: INFO nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Took 4.87 seconds to spawn the instance on the hypervisor.
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-36e7b00d-3337-468b-9324-2a91371f65f1 req-d020dcb3-83f6-4e95-b358-f5f93c7b1a9c service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-36e7b00d-3337-468b-9324-2a91371f65f1 req-d020dcb3-83f6-4e95-b358-f5f93c7b1a9c service nova] Acquiring lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-36e7b00d-3337-468b-9324-2a91371f65f1 req-d020dcb3-83f6-4e95-b358-f5f93c7b1a9c service nova] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-36e7b00d-3337-468b-9324-2a91371f65f1 req-d020dcb3-83f6-4e95-b358-f5f93c7b1a9c service nova] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:29 user nova-compute[74241]: DEBUG nova.compute.manager [req-36e7b00d-3337-468b-9324-2a91371f65f1 req-d020dcb3-83f6-4e95-b358-f5f93c7b1a9c service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] No waiting events found dispatching network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:13:29 user nova-compute[74241]: WARNING nova.compute.manager [req-36e7b00d-3337-468b-9324-2a91371f65f1 req-d020dcb3-83f6-4e95-b358-f5f93c7b1a9c service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received unexpected event network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 for instance with vm_state building and task_state spawning.
Oct 20 12:13:29 user nova-compute[74241]: INFO nova.compute.manager [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Took 21.94 seconds to build instance.
Oct 20 12:13:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d8319507-ad34-4371-8e5f-f5b8da63b9f1 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.034s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:13:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:13:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:13:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:14:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:13 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:14:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:14:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:14:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:14:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:14:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:14:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:14:23 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:14:23 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:14:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=25.174686431884766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3852f29a-2048-49b5-a381-2fba26f56bc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:14:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.368s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:14:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:24 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:14:25 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:14:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:14:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:14:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:14:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:14:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 3852f29a-2048-49b5-a381-2fba26f56bc0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 12:14:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 12:14:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:14:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:14:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:41 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:14:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:14:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:14:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:14:51 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:53 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:14:53 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 12:14:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:14:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-1fd30c03-ed21-4c41-81b8-d0a51af24b44 req-5564ce26-ee2c-435b-8335-956882c02adf service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-changed-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:15:00 user nova-compute[74241]: DEBUG nova.compute.manager [req-1fd30c03-ed21-4c41-81b8-d0a51af24b44 req-5564ce26-ee2c-435b-8335-956882c02adf service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Refreshing instance network info cache due to event network-changed-b4d15b2b-b7d8-492a-822b-63074d420ac9. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:15:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1fd30c03-ed21-4c41-81b8-d0a51af24b44 req-5564ce26-ee2c-435b-8335-956882c02adf service nova] Acquiring lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:15:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1fd30c03-ed21-4c41-81b8-d0a51af24b44 req-5564ce26-ee2c-435b-8335-956882c02adf service nova] Acquired lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:15:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-1fd30c03-ed21-4c41-81b8-d0a51af24b44 req-5564ce26-ee2c-435b-8335-956882c02adf service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Refreshing network info cache for port b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:15:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-1fd30c03-ed21-4c41-81b8-d0a51af24b44 req-5564ce26-ee2c-435b-8335-956882c02adf service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updated VIF entry in instance network info cache for port b4d15b2b-b7d8-492a-822b-63074d420ac9. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:15:00 user nova-compute[74241]: DEBUG nova.network.neutron [req-1fd30c03-ed21-4c41-81b8-d0a51af24b44 req-5564ce26-ee2c-435b-8335-956882c02adf service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:15:00 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1fd30c03-ed21-4c41-81b8-d0a51af24b44 req-5564ce26-ee2c-435b-8335-956882c02adf service nova] Releasing lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:15:01 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:07 user nova-compute[74241]: INFO nova.compute.manager [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Unshelving
Oct 20 12:15:07 user nova-compute[74241]: INFO nova.virt.block_device [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Booting with volume ade2b124-a620-41e7-a735-c575b1e6a976 at /dev/vdc
Oct 20 12:15:07 user nova-compute[74241]: DEBUG os_brick.utils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14fe525-124e-42da-b151-04dde420ef21]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de09f17-aff0-4497-a0d1-ec9685823a68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb22c04c-2584-4d9d-868b-1b564b7e8b89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[263f81de-dfe3-41ae-b3b8-6fa5079be46b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:15:07 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:15:07 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[55517619-0ddb-4579-ae30-7c6d91344e61]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG os_brick.utils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:15:07 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating existing volume attachment record: 650f503d-5f80-46fc-a023-abc15b6be59c {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:15:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:11 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:15 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:15:16 user nova-compute[74241]: INFO nova.compute.claims [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Claim successful on node user
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.network.neutron [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:15:16 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG nova.policy [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf5346976b7f45e1b146911555f458eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6744161987c43408e35c847ec2055a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:15:16 user nova-compute[74241]: INFO nova.virt.block_device [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Booting with volume 30e82077-0447-4a9a-a02f-dcda9d355a12 at /dev/vda
Oct 20 12:15:16 user nova-compute[74241]: DEBUG os_brick.utils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[03770ecd-2278-4feb-bb87-6694f49949d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab22f26-7783-41c4-9d6a-7d01dcd89ba8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[36566594-7d22-45cd-936c-ee1d3d9f7ef9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001864f-98ce-4505-a75e-ccf5bfc931d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:16 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:15:17 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:15:17 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[897920da-e39a-4d5c-b54c-daf21b6ab271]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG os_brick.utils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updating existing volume attachment record: 7fe59fa1-08f8-4a0b-817d-eb5357118c9e {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG nova.network.neutron [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Successfully created port: 7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:15:17 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Successfully updated port: 7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquired lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-d7b132c1-fcdc-4efa-af1b-53ebec1021f4 req-65d1415d-abe4-4c36-8f0e-c3b7805e9809 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-changed-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.compute.manager [req-d7b132c1-fcdc-4efa-af1b-53ebec1021f4 req-65d1415d-abe4-4c36-8f0e-c3b7805e9809 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Refreshing instance network info cache due to event network-changed-7d9fde9f-90f5-4236-82f6-2b8ff2598b01. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d7b132c1-fcdc-4efa-af1b-53ebec1021f4 req-65d1415d-abe4-4c36-8f0e-c3b7805e9809 service nova] Acquiring lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.network.neutron [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updating instance_info_cache with network_info: [{"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Releasing lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Instance network_info: |[{"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d7b132c1-fcdc-4efa-af1b-53ebec1021f4 req-65d1415d-abe4-4c36-8f0e-c3b7805e9809 service nova] Acquired lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-d7b132c1-fcdc-4efa-af1b-53ebec1021f4 req-65d1415d-abe4-4c36-8f0e-c3b7805e9809 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Refreshing network info cache for port 7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-d7b132c1-fcdc-4efa-af1b-53ebec1021f4 req-65d1415d-abe4-4c36-8f0e-c3b7805e9809 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updated VIF entry in instance network info cache for port 7d9fde9f-90f5-4236-82f6-2b8ff2598b01. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-d7b132c1-fcdc-4efa-af1b-53ebec1021f4 req-65d1415d-abe4-4c36-8f0e-c3b7805e9809 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updating instance_info_cache with network_info: [{"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:15:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d7b132c1-fcdc-4efa-af1b-53ebec1021f4 req-65d1415d-abe4-4c36-8f0e-c3b7805e9809 service nova] Releasing lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:15:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:22 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:15:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:15:23 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:15:23 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.173381805419922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3852f29a-2048-49b5-a381-2fba26f56bc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e2fafe88-71f6-4a40-be2b-cb939aedc8ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:15:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'pci_requests' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:15:24 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'numa_topology' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:15:24 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:15:24 user nova-compute[74241]: INFO nova.compute.claims [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Claim successful on node user
Oct 20 12:15:24 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:15:24 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:15:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:24 user nova-compute[74241]: INFO nova.network.neutron [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating port 1e5abd04-e0a2-45d3-b060-3a3698250e7a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 12:15:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-5ad45af7-9c93-4bda-a3cd-6cbae6a7ac9d req-03d1b340-1508-481c-b1bd-7fddd796e120 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-changed-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.compute.manager [req-5ad45af7-9c93-4bda-a3cd-6cbae6a7ac9d req-03d1b340-1508-481c-b1bd-7fddd796e120 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Refreshing instance network info cache due to event network-changed-1e5abd04-e0a2-45d3-b060-3a3698250e7a. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ad45af7-9c93-4bda-a3cd-6cbae6a7ac9d req-03d1b340-1508-481c-b1bd-7fddd796e120 service nova] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:15:25 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Creating image(s)
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'trusted_certs' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ad45af7-9c93-4bda-a3cd-6cbae6a7ac9d req-03d1b340-1508-481c-b1bd-7fddd796e120 service nova] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.network.neutron [req-5ad45af7-9c93-4bda-a3cd-6cbae6a7ac9d req-03d1b340-1508-481c-b1bd-7fddd796e120 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Refreshing network info cache for port 1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.objects.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "821fcf88786adec53a17447695dc6fc8a70d1988" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "821fcf88786adec53a17447695dc6fc8a70d1988" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:25 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:15:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:26 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:26 user nova-compute[74241]: DEBUG nova.virt.images [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] 1853915e-aa59-4ab8-86dd-1db74d84c7d2 was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 12:15:26 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 12:15:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988.part /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:26 user nova-compute[74241]: DEBUG nova.network.neutron [req-5ad45af7-9c93-4bda-a3cd-6cbae6a7ac9d req-03d1b340-1508-481c-b1bd-7fddd796e120 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updated VIF entry in instance network info cache for port 1e5abd04-e0a2-45d3-b060-3a3698250e7a. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:15:26 user nova-compute[74241]: DEBUG nova.network.neutron [req-5ad45af7-9c93-4bda-a3cd-6cbae6a7ac9d req-03d1b340-1508-481c-b1bd-7fddd796e120 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-5ad45af7-9c93-4bda-a3cd-6cbae6a7ac9d req-03d1b340-1508-481c-b1bd-7fddd796e120 service nova] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988.part /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988.converted" returned: 0 in 0.629s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Skipping network cache update for instance because it is Building. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "821fcf88786adec53a17447695dc6fc8a70d1988" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.081s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 3852f29a-2048-49b5-a381-2fba26f56bc0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988 --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "821fcf88786adec53a17447695dc6fc8a70d1988" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "821fcf88786adec53a17447695dc6fc8a70d1988" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:27 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988 --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988,backing_fmt=raw /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988,backing_fmt=raw /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk 1073741824" returned: 0 in 0.048s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "821fcf88786adec53a17447695dc6fc8a70d1988" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/821fcf88786adec53a17447695dc6fc8a70d1988 --force-share --output=json" returned: 0 in 0.179s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'migration_context' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG nova.objects.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:15:28 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Rebasing disk image.
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 -F raw /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 -F raw /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk" returned: 0 in 2.264s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Ensure instance console log exists: /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Start _get_guest_xml network_info=[{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e77a178e66187f97a8db7276510795b3',container_format='bare',created_at=2023-10-20T12:13:15Z,direct_url=<?>,disk_format='qcow2',id=1853915e-aa59-4ab8-86dd-1db74d84c7d2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1714880826-shelved',owner='f3600c43897b483fb6ed35091763bc01',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T12:13:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': None, 'attachment_id': '650f503d-5f80-46fc-a023-abc15b6be59c', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTobZUpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2', 'attached_at': '', 'detached_at': '', 'volume_id': 'ade2b124-a620-41e7-a735-c575b1e6a976', 'serial': 'ade2b124-a620-41e7-a735-c575b1e6a976'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:15:30 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:15:30 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e77a178e66187f97a8db7276510795b3',container_format='bare',created_at=2023-10-20T12:13:15Z,direct_url=<?>,disk_format='qcow2',id=1853915e-aa59-4ab8-86dd-1db74d84c7d2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1714880826-shelved',owner='f3600c43897b483fb6ed35091763bc01',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T12:13:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'vcpu_model' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.objects.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTobZUpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:15:30 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:15:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:15:30 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:15:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:15:30 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bc70ae-ee7b-4cd7-9c88-7b00b99ab7c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:15:30 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef818f4-9642-4160-be34-01143c5a835a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976] added
Oct 20 12:15:30 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.058s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c820c-9522-47c8-9f8c-7c49a68d8aec]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.126s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57cde8b-ad3c-47c6-82fb-94d2af28cee0]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JTobZUpm {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JTobZUpm" returned: 0 in 0.029s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecf3f3d-1adb-4df0-92c7-3f906ffe96bf]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JTobZUpm'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d29f56-f76b-458b-b856-d7bb046a4cb7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8c8a07-e7ba-4236-b3c1-2c33cc2f521a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:15:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:15:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc24db23-d8de-4947-9497-78433cce323a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976, portal: 172.16.0.220,3260]
Oct 20 12:15:31 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976, portal: 172.16.0.220,3260] successful.
Oct 20 12:15:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1956fd-9270-48b0-9a11-d12a511bdcd7]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[748204cd-dce2-4760-ab0d-efd735d29547]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:15:31 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:15:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:15:31 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:15:31 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e5cf3-2588-4ba1-ba75-b4db22a5ac6c]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTobZUpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:15:31 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23235316339626566', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235316339626566', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714880826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714880826',id=48,image_ref='1853915e-aa59-4ab8-86dd-1db74d84c7d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-936351467',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ja2tzwwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member',shelved_at='2023-10-20T12:13:19.161738',shelved_host='user',shelved_image_id='1853915e-aa59-4ab8-86dd-1db74d84c7d2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'pci_devices' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.objects.base [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:15:32 user nova-compute[74241]:   <uuid>e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2</uuid>
Oct 20 12:15:32 user nova-compute[74241]:   <name>instance-00000030</name>
Oct 20 12:15:32 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:15:32 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:15:32 user nova-compute[74241]:   <metadata>
Oct 20 12:15:32 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:15:32 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:15:32 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1714880826</nova:name>
Oct 20 12:15:32 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:15:30</nova:creationTime>
Oct 20 12:15:32 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:15:32 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:15:32 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:15:32 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:15:32 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:15:32 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:15:32 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:15:32 user nova-compute[74241]:       <nova:owner>
Oct 20 12:15:32 user nova-compute[74241]:         <nova:user uuid="a5402b24624c44ae88239677c5778850">tempest-AttachVolumeShelveTestJSON-882980696-project-member</nova:user>
Oct 20 12:15:32 user nova-compute[74241]:         <nova:project uuid="f3600c43897b483fb6ed35091763bc01">tempest-AttachVolumeShelveTestJSON-882980696</nova:project>
Oct 20 12:15:32 user nova-compute[74241]:       </nova:owner>
Oct 20 12:15:32 user nova-compute[74241]:       <nova:root type="image" uuid="1853915e-aa59-4ab8-86dd-1db74d84c7d2"/>
Oct 20 12:15:32 user nova-compute[74241]:       <nova:ports>
Oct 20 12:15:32 user nova-compute[74241]:         <nova:port uuid="1e5abd04-e0a2-45d3-b060-3a3698250e7a">
Oct 20 12:15:32 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 12:15:32 user nova-compute[74241]:         </nova:port>
Oct 20 12:15:32 user nova-compute[74241]:       </nova:ports>
Oct 20 12:15:32 user nova-compute[74241]:     </nova:instance>
Oct 20 12:15:32 user nova-compute[74241]:   </metadata>
Oct 20 12:15:32 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:15:32 user nova-compute[74241]:     <system>
Oct 20 12:15:32 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:15:32 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:15:32 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:15:32 user nova-compute[74241]:       <entry name="serial">e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2</entry>
Oct 20 12:15:32 user nova-compute[74241]:       <entry name="uuid">e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2</entry>
Oct 20 12:15:32 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:15:32 user nova-compute[74241]:     </system>
Oct 20 12:15:32 user nova-compute[74241]:   </sysinfo>
Oct 20 12:15:32 user nova-compute[74241]:   <os>
Oct 20 12:15:32 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:15:32 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:15:32 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:15:32 user nova-compute[74241]:   </os>
Oct 20 12:15:32 user nova-compute[74241]:   <features>
Oct 20 12:15:32 user nova-compute[74241]:     <acpi/>
Oct 20 12:15:32 user nova-compute[74241]:     <apic/>
Oct 20 12:15:32 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:15:32 user nova-compute[74241]:   </features>
Oct 20 12:15:32 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:15:32 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:15:32 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:15:32 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:15:32 user nova-compute[74241]:   </clock>
Oct 20 12:15:32 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:15:32 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:15:32 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:15:32 user nova-compute[74241]:   </cpu>
Oct 20 12:15:32 user nova-compute[74241]:   <devices>
Oct 20 12:15:32 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:15:32 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:15:32 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk"/>
Oct 20 12:15:32 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:15:32 user nova-compute[74241]:     </disk>
Oct 20 12:15:32 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:15:32 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:15:32 user nova-compute[74241]:       <source dev="/dev/sdc"/>
Oct 20 12:15:32 user nova-compute[74241]:       <target dev="vdc" bus="virtio"/>
Oct 20 12:15:32 user nova-compute[74241]:       <serial>ade2b124-a620-41e7-a735-c575b1e6a976</serial>
Oct 20 12:15:32 user nova-compute[74241]:     </disk>
Oct 20 12:15:32 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:15:32 user nova-compute[74241]:       <mac address="fa:16:3e:3f:47:e0"/>
Oct 20 12:15:32 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:15:32 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:15:32 user nova-compute[74241]:       <target dev="tap1e5abd04-e0"/>
Oct 20 12:15:32 user nova-compute[74241]:     </interface>
Oct 20 12:15:32 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:15:32 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/console.log" append="off"/>
Oct 20 12:15:32 user nova-compute[74241]:     </serial>
Oct 20 12:15:32 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:15:32 user nova-compute[74241]:     <video>
Oct 20 12:15:32 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:15:32 user nova-compute[74241]:     </video>
Oct 20 12:15:32 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:15:32 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:15:32 user nova-compute[74241]:     </rng>
Oct 20 12:15:32 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:15:32 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:15:32 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:15:32 user nova-compute[74241]:     </memballoon>
Oct 20 12:15:32 user nova-compute[74241]:   </devices>
Oct 20 12:15:32 user nova-compute[74241]: </domain>
Oct 20 12:15:32 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714880826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714880826',id=48,image_ref='1853915e-aa59-4ab8-86dd-1db74d84c7d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-936351467',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:11:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ja2tzwwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member',shelved_at='2023-10-20T12:13:19.161738',shelved_host='user',shelved_image_id='1853915e-aa59-4ab8-86dd-1db74d84c7d2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:15:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG os_vif [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66c83001-c4e0-5b2f-8e28-1be2aca47a54', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e5abd04-e0, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e5abd04-e0, col_values=(('qos', UUID('7106aa62-b78c-4c8e-8769-c16764183cde')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e5abd04-e0, col_values=(('external_ids', {'iface-id': '1e5abd04-e0a2-45d3-b060-3a3698250e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:47:e0', 'vm-uuid': 'e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:32 user nova-compute[74241]: INFO os_vif [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0')
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:15:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No VIF found with MAC fa:16:3e:3f:47:e0, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:15:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-7df2733b-8d10-4bf5-9b82-d64868d05994 req-b54d83b7-6f20-4ec5-a077-39a8d1ccba09 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7df2733b-8d10-4bf5-9b82-d64868d05994 req-b54d83b7-6f20-4ec5-a077-39a8d1ccba09 service nova] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7df2733b-8d10-4bf5-9b82-d64868d05994 req-b54d83b7-6f20-4ec5-a077-39a8d1ccba09 service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-7df2733b-8d10-4bf5-9b82-d64868d05994 req-b54d83b7-6f20-4ec5-a077-39a8d1ccba09 service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-7df2733b-8d10-4bf5-9b82-d64868d05994 req-b54d83b7-6f20-4ec5-a077-39a8d1ccba09 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] No waiting events found dispatching network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:15:34 user nova-compute[74241]: WARNING nova.compute.manager [req-7df2733b-8d10-4bf5-9b82-d64868d05994 req-b54d83b7-6f20-4ec5-a077-39a8d1ccba09 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received unexpected event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:15:34 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Creating image(s)
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Did not create local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Ensure instance console log exists: /opt/stack/data/nova/instances/e2fafe88-71f6-4a40-be2b-cb939aedc8ea/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Start _get_guest_xml network_info=[{"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '7fe59fa1-08f8-4a0b-817d-eb5357118c9e', 'delete_on_termination': False, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psgleuox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2fafe88-71f6-4a40-be2b-cb939aedc8ea', 'attached_at': '', 'detached_at': '', 'volume_id': '30e82077-0447-4a9a-a02f-dcda9d355a12', 'serial': '30e82077-0447-4a9a-a02f-dcda9d355a12'}, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:15:34 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:15:34 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psgleuox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:15:34 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:15:34 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:15:34 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df70f89-cca3-4c52-b4a1-ae7c1d590efa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:15:34 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5c9bf4-d3dc-40f6-9ff2-397f30f5ebb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12] added
Oct 20 12:15:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b6b981-9aaa-44be-a725-171eca964ec5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8484dc-6944-4bb5-807d-a69c5b519b7b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psgleuox {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v psgleuox" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6059e2e-d93f-4648-99a8-d5d52b099c0a]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'psgleuox'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8280dd71-d4c3-4cdb-aee9-7f9eef328231]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[81359ed4-c63e-47f1-b012-cf324256a106]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:15:34 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:15:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:15:34 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:15:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[42554f1f-e575-4444-b6a1-ae55338a8d07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12, portal: 172.16.0.220,3260]
Oct 20 12:15:34 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12, portal: 172.16.0.220,3260] successful.
Oct 20 12:15:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f28a35-ef54-49e9-806f-8b14851bd030]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b09cdd0-0cc8-4fdf-b0f5-e63c1b39d96c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:15:34 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:15:34 user nova-compute[74241]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 (non-flash)
Oct 20 12:15:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:15:34 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:15:34 user nova-compute[74241]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 (non-flash)
Oct 20 12:15:34 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f409e3d9-f9fd-46ed-bc1b-a75d5a8c60c1]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psgleuox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:15:34 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26131626139353762', 'path': '/dev/sdd'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131626139353762', 'path': '/dev/sdd'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-28195862',display_name='tempest-TestVolumeBootPattern-server-28195862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-28195862',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-q51njrey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:15:17Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=e2fafe88-71f6-4a40-be2b-cb939aedc8ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:15:77,bridge_name='br-int',has_traffic_filtering=True,id=7d9fde9f-90f5-4236-82f6-2b8ff2598b01,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fde9f-90') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.objects.instance [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'pci_devices' on Instance uuid e2fafe88-71f6-4a40-be2b-cb939aedc8ea {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:15:35 user nova-compute[74241]:   <uuid>e2fafe88-71f6-4a40-be2b-cb939aedc8ea</uuid>
Oct 20 12:15:35 user nova-compute[74241]:   <name>instance-00000032</name>
Oct 20 12:15:35 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:15:35 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:15:35 user nova-compute[74241]:   <metadata>
Oct 20 12:15:35 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:15:35 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:15:35 user nova-compute[74241]:       <nova:name>tempest-TestVolumeBootPattern-server-28195862</nova:name>
Oct 20 12:15:35 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:15:34</nova:creationTime>
Oct 20 12:15:35 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:15:35 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:15:35 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:15:35 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:15:35 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:15:35 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:15:35 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:15:35 user nova-compute[74241]:       <nova:owner>
Oct 20 12:15:35 user nova-compute[74241]:         <nova:user uuid="bf5346976b7f45e1b146911555f458eb">tempest-TestVolumeBootPattern-71867186-project-member</nova:user>
Oct 20 12:15:35 user nova-compute[74241]:         <nova:project uuid="e6744161987c43408e35c847ec2055a5">tempest-TestVolumeBootPattern-71867186</nova:project>
Oct 20 12:15:35 user nova-compute[74241]:       </nova:owner>
Oct 20 12:15:35 user nova-compute[74241]:       <nova:ports>
Oct 20 12:15:35 user nova-compute[74241]:         <nova:port uuid="7d9fde9f-90f5-4236-82f6-2b8ff2598b01">
Oct 20 12:15:35 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 12:15:35 user nova-compute[74241]:         </nova:port>
Oct 20 12:15:35 user nova-compute[74241]:       </nova:ports>
Oct 20 12:15:35 user nova-compute[74241]:     </nova:instance>
Oct 20 12:15:35 user nova-compute[74241]:   </metadata>
Oct 20 12:15:35 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:15:35 user nova-compute[74241]:     <system>
Oct 20 12:15:35 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:15:35 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:15:35 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:15:35 user nova-compute[74241]:       <entry name="serial">e2fafe88-71f6-4a40-be2b-cb939aedc8ea</entry>
Oct 20 12:15:35 user nova-compute[74241]:       <entry name="uuid">e2fafe88-71f6-4a40-be2b-cb939aedc8ea</entry>
Oct 20 12:15:35 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:15:35 user nova-compute[74241]:     </system>
Oct 20 12:15:35 user nova-compute[74241]:   </sysinfo>
Oct 20 12:15:35 user nova-compute[74241]:   <os>
Oct 20 12:15:35 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:15:35 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:15:35 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:15:35 user nova-compute[74241]:   </os>
Oct 20 12:15:35 user nova-compute[74241]:   <features>
Oct 20 12:15:35 user nova-compute[74241]:     <acpi/>
Oct 20 12:15:35 user nova-compute[74241]:     <apic/>
Oct 20 12:15:35 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:15:35 user nova-compute[74241]:   </features>
Oct 20 12:15:35 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:15:35 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:15:35 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:15:35 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:15:35 user nova-compute[74241]:   </clock>
Oct 20 12:15:35 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:15:35 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:15:35 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:15:35 user nova-compute[74241]:   </cpu>
Oct 20 12:15:35 user nova-compute[74241]:   <devices>
Oct 20 12:15:35 user nova-compute[74241]:     <disk type="block" device="disk">
Oct 20 12:15:35 user nova-compute[74241]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:15:35 user nova-compute[74241]:       <source dev="/dev/sdd"/>
Oct 20 12:15:35 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:15:35 user nova-compute[74241]:       <serial>30e82077-0447-4a9a-a02f-dcda9d355a12</serial>
Oct 20 12:15:35 user nova-compute[74241]:     </disk>
Oct 20 12:15:35 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:15:35 user nova-compute[74241]:       <mac address="fa:16:3e:77:15:77"/>
Oct 20 12:15:35 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:15:35 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:15:35 user nova-compute[74241]:       <target dev="tap7d9fde9f-90"/>
Oct 20 12:15:35 user nova-compute[74241]:     </interface>
Oct 20 12:15:35 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:15:35 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/e2fafe88-71f6-4a40-be2b-cb939aedc8ea/console.log" append="off"/>
Oct 20 12:15:35 user nova-compute[74241]:     </serial>
Oct 20 12:15:35 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:15:35 user nova-compute[74241]:     <video>
Oct 20 12:15:35 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:15:35 user nova-compute[74241]:     </video>
Oct 20 12:15:35 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:15:35 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:15:35 user nova-compute[74241]:     </rng>
Oct 20 12:15:35 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:15:35 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:15:35 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:15:35 user nova-compute[74241]:     </memballoon>
Oct 20 12:15:35 user nova-compute[74241]:   </devices>
Oct 20 12:15:35 user nova-compute[74241]: </domain>
Oct 20 12:15:35 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-28195862',display_name='tempest-TestVolumeBootPattern-server-28195862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-28195862',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-q51njrey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:15:17Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=e2fafe88-71f6-4a40-be2b-cb939aedc8ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:15:77,bridge_name='br-int',has_traffic_filtering=True,id=7d9fde9f-90f5-4236-82f6-2b8ff2598b01,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fde9f-90') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG os_vif [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:15:77,bridge_name='br-int',has_traffic_filtering=True,id=7d9fde9f-90f5-4236-82f6-2b8ff2598b01,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fde9f-90') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '84edd163-1006-5afe-b47d-05c0938ba258', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d9fde9f-90, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d9fde9f-90, col_values=(('qos', UUID('5f76a2e0-0478-4b62-bff1-efce23e549ed')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d9fde9f-90, col_values=(('external_ids', {'iface-id': '7d9fde9f-90f5-4236-82f6-2b8ff2598b01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:15:77', 'vm-uuid': 'e2fafe88-71f6-4a40-be2b-cb939aedc8ea'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:35 user nova-compute[74241]: INFO os_vif [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:15:77,bridge_name='br-int',has_traffic_filtering=True,id=7d9fde9f-90f5-4236-82f6-2b8ff2598b01,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fde9f-90')
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] No VIF found with MAC fa:16:3e:77:15:77, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:15:35 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:15:35 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance spawned successfully.
Oct 20 12:15:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:15:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-ec8bc707-b1ec-4405-afd9-0729c9c90386 req-aad6c67d-4571-47e1-b2ee-6060c78114b1 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:15:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ec8bc707-b1ec-4405-afd9-0729c9c90386 req-aad6c67d-4571-47e1-b2ee-6060c78114b1 service nova] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ec8bc707-b1ec-4405-afd9-0729c9c90386 req-aad6c67d-4571-47e1-b2ee-6060c78114b1 service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-ec8bc707-b1ec-4405-afd9-0729c9c90386 req-aad6c67d-4571-47e1-b2ee-6060c78114b1 service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-ec8bc707-b1ec-4405-afd9-0729c9c90386 req-aad6c67d-4571-47e1-b2ee-6060c78114b1 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] No waiting events found dispatching network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:15:36 user nova-compute[74241]: WARNING nova.compute.manager [req-ec8bc707-b1ec-4405-afd9-0729c9c90386 req-aad6c67d-4571-47e1-b2ee-6060c78114b1 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received unexpected event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 12:15:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f570bdf6-c92d-4a81-9575-ba318ddcf637 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 29.071s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:36 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG nova.compute.manager [req-1223a1e0-0f5c-4e01-b785-3b88a3a8af5b req-07bb9420-a8bb-4585-9511-e2e37a0d3eb5 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1223a1e0-0f5c-4e01-b785-3b88a3a8af5b req-07bb9420-a8bb-4585-9511-e2e37a0d3eb5 service nova] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1223a1e0-0f5c-4e01-b785-3b88a3a8af5b req-07bb9420-a8bb-4585-9511-e2e37a0d3eb5 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-1223a1e0-0f5c-4e01-b785-3b88a3a8af5b req-07bb9420-a8bb-4585-9511-e2e37a0d3eb5 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG nova.compute.manager [req-1223a1e0-0f5c-4e01-b785-3b88a3a8af5b req-07bb9420-a8bb-4585-9511-e2e37a0d3eb5 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] No waiting events found dispatching network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:15:37 user nova-compute[74241]: WARNING nova.compute.manager [req-1223a1e0-0f5c-4e01-b785-3b88a3a8af5b req-07bb9420-a8bb-4585-9511-e2e37a0d3eb5 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received unexpected event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 for instance with vm_state building and task_state spawning.
Oct 20 12:15:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:15:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Instance spawned successfully.
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-012ad910-dbfd-437d-ba97-94d81ecb2fe4 req-3712526d-9e40-4346-9d6e-556fcc385e99 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-012ad910-dbfd-437d-ba97-94d81ecb2fe4 req-3712526d-9e40-4346-9d6e-556fcc385e99 service nova] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-012ad910-dbfd-437d-ba97-94d81ecb2fe4 req-3712526d-9e40-4346-9d6e-556fcc385e99 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-012ad910-dbfd-437d-ba97-94d81ecb2fe4 req-3712526d-9e40-4346-9d6e-556fcc385e99 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-012ad910-dbfd-437d-ba97-94d81ecb2fe4 req-3712526d-9e40-4346-9d6e-556fcc385e99 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] No waiting events found dispatching network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:15:39 user nova-compute[74241]: WARNING nova.compute.manager [req-012ad910-dbfd-437d-ba97-94d81ecb2fe4 req-3712526d-9e40-4346-9d6e-556fcc385e99 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received unexpected event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 for instance with vm_state building and task_state spawning.
Oct 20 12:15:39 user nova-compute[74241]: INFO nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Took 5.04 seconds to spawn the instance on the hypervisor.
Oct 20 12:15:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:15:39 user nova-compute[74241]: INFO nova.compute.manager [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Took 22.97 seconds to build instance.
Oct 20 12:15:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-33decf8f-646d-47b1-8282-e6b96924674e tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.067s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:15:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:15:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:15:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:15:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:15:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:15:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:16:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:16:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:16 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:16:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:16:24 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:16:24 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8659MB free_disk=25.146347045898438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3852f29a-2048-49b5-a381-2fba26f56bc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e2fafe88-71f6-4a40-be2b-cb939aedc8ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:16:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:16:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:16:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:16:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:26 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:16:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:16:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:16:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:16:27 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:16:28 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [{"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:16:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:16:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:16:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:16:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:16:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:31 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:16:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:16:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:16:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:16:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:16:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:16:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:16:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:16:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:16:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:16:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:16:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:16:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:16:57 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:16:57 user nova-compute[74241]: INFO nova.compute.manager [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Detaching volume ade2b124-a620-41e7-a735-c575b1e6a976
Oct 20 12:16:57 user nova-compute[74241]: INFO nova.virt.block_device [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Attempting to driver detach volume ade2b124-a620-41e7-a735-c575b1e6a976 from mountpoint /dev/vdc
Oct 20 12:16:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Attempting to detach device vdc from instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:16:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:16:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:16:57 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:16:57 user nova-compute[74241]:   <target dev="vdc" bus="virtio"/>
Oct 20 12:16:57 user nova-compute[74241]:   <serial>ade2b124-a620-41e7-a735-c575b1e6a976</serial>
Oct 20 12:16:57 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 12:16:57 user nova-compute[74241]: </disk>
Oct 20 12:16:57 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:16:57 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully detached device vdc from instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 from the persistent domain config.
Oct 20 12:16:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:16:57 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:16:57 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:16:57 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:16:57 user nova-compute[74241]:   <target dev="vdc" bus="virtio"/>
Oct 20 12:16:57 user nova-compute[74241]:   <serial>ade2b124-a620-41e7-a735-c575b1e6a976</serial>
Oct 20 12:16:57 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 12:16:57 user nova-compute[74241]: </disk>
Oct 20 12:16:57 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:16:58 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:16:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:17:06 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-d588ddb2-55b5-4583-8b1f-e5ad71923bcc req-261c6af1-2cb7-44fc-bae7-1c0e3c9afc50 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-changed-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:07 user nova-compute[74241]: DEBUG nova.compute.manager [req-d588ddb2-55b5-4583-8b1f-e5ad71923bcc req-261c6af1-2cb7-44fc-bae7-1c0e3c9afc50 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Refreshing instance network info cache due to event network-changed-7d9fde9f-90f5-4236-82f6-2b8ff2598b01. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:17:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d588ddb2-55b5-4583-8b1f-e5ad71923bcc req-261c6af1-2cb7-44fc-bae7-1c0e3c9afc50 service nova] Acquiring lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:17:07 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d588ddb2-55b5-4583-8b1f-e5ad71923bcc req-261c6af1-2cb7-44fc-bae7-1c0e3c9afc50 service nova] Acquired lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:17:07 user nova-compute[74241]: DEBUG nova.network.neutron [req-d588ddb2-55b5-4583-8b1f-e5ad71923bcc req-261c6af1-2cb7-44fc-bae7-1c0e3c9afc50 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Refreshing network info cache for port 7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG nova.network.neutron [req-d588ddb2-55b5-4583-8b1f-e5ad71923bcc req-261c6af1-2cb7-44fc-bae7-1c0e3c9afc50 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updated VIF entry in instance network info cache for port 7d9fde9f-90f5-4236-82f6-2b8ff2598b01. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG nova.network.neutron [req-d588ddb2-55b5-4583-8b1f-e5ad71923bcc req-261c6af1-2cb7-44fc-bae7-1c0e3c9afc50 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updating instance_info_cache with network_info: [{"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d588ddb2-55b5-4583-8b1f-e5ad71923bcc req-261c6af1-2cb7-44fc-bae7-1c0e3c9afc50 service nova] Releasing lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:08 user nova-compute[74241]: INFO nova.compute.manager [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Terminating instance
Oct 20 12:17:08 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-d128ff29-03ca-4f52-b322-0e4edaf73c2b req-60388917-e080-4469-9bd4-0897e3f38980 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-unplugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d128ff29-03ca-4f52-b322-0e4edaf73c2b req-60388917-e080-4469-9bd4-0897e3f38980 service nova] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d128ff29-03ca-4f52-b322-0e4edaf73c2b req-60388917-e080-4469-9bd4-0897e3f38980 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d128ff29-03ca-4f52-b322-0e4edaf73c2b req-60388917-e080-4469-9bd4-0897e3f38980 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-d128ff29-03ca-4f52-b322-0e4edaf73c2b req-60388917-e080-4469-9bd4-0897e3f38980 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] No waiting events found dispatching network-vif-unplugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG nova.compute.manager [req-d128ff29-03ca-4f52-b322-0e4edaf73c2b req-60388917-e080-4469-9bd4-0897e3f38980 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-unplugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:17:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Instance destroyed successfully.
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'resources' on Instance uuid e2fafe88-71f6-4a40-be2b-cb939aedc8ea {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:15:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-28195862',display_name='tempest-TestVolumeBootPattern-server-28195862',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-28195862',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:15:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-q51njrey',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:15:39Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=e2fafe88-71f6-4a40-be2b-cb939aedc8ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:15:77,bridge_name='br-int',has_traffic_filtering=True,id=7d9fde9f-90f5-4236-82f6-2b8ff2598b01,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fde9f-90') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_vif [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:15:77,bridge_name='br-int',has_traffic_filtering=True,id=7d9fde9f-90f5-4236-82f6-2b8ff2598b01,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fde9f-90') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d9fde9f-90, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f76a2e0-0478-4b62-bff1-efce23e549ed) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:17:09 user nova-compute[74241]: INFO os_vif [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:15:77,bridge_name='br-int',has_traffic_filtering=True,id=7d9fde9f-90f5-4236-82f6-2b8ff2598b01,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9fde9f-90')
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'psgleuox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:17:09 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e88555-62c7-4d15-a427-e62064b04e1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:17:09 user nova-compute[74241]: No targets found.
Oct 20 12:17:09 user nova-compute[74241]: iSNS:
Oct 20 12:17:09 user nova-compute[74241]: No targets found.
Oct 20 12:17:09 user nova-compute[74241]: STATIC:
Oct 20 12:17:09 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12
Oct 20 12:17:09 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:17:09 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:17:09 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b
Oct 20 12:17:09 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:17:09 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:17:09 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976
Oct 20 12:17:09 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:17:09 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:17:09 user nova-compute[74241]: FIRMWARE:
Oct 20 12:17:09 user nova-compute[74241]: No targets found.
Oct 20 12:17:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:17:09 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:17:09 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b157d3-58df-4d63-9bf7-bc9f722d998f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1f376e-8000-4f29-86e4-ddc137e521fc]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:17:09 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:17:09 user nova-compute[74241]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 (non-flash)
Oct 20 12:17:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:17:09 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:17:09 user nova-compute[74241]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 (non-flash)
Oct 20 12:17:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52086c35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12'): ({'sdd'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Removing single pathed devices sdd {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff29718-1148-4e63-99c6-ed17b11bba21]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fd4ed2-d5ed-4b8c-92f4-5110c22b0853]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flushing IO for device /dev/sdd {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[844e7840-47e0-4e82-b943-9a98b1171cf9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f25acd6-b893-47ac-850f-7a5963e1adb7]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] SCSI volumes sdd have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOebaa2f1-a1ba957b3c5539ef', '/dev/disk/by-id/scsi-26131626139353762', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ebaa2f1') {{(pid=85185) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[096f6290-af30-457c-a1a6-2eee5d7748da]: (4, None) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e924b48-5438-4a60-aa0b-bc78ef067755]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26aecfd-5588-4c0a-b926-8a186830c090]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12, portal: 172.16.0.220,3260]
Oct 20 12:17:09 user nova-compute[74241]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12, portal: 172.16.0.220,3260] successful.
Oct 20 12:17:09 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30e82077-0447-4a9a-a02f-dcda9d355a12 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[971a7aea-65c4-4c68-97f7-3cf108776018]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== disconnect_volume: return (311ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:17:09 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Deleting instance files /opt/stack/data/nova/instances/e2fafe88-71f6-4a40-be2b-cb939aedc8ea_del
Oct 20 12:17:09 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Deletion of /opt/stack/data/nova/instances/e2fafe88-71f6-4a40-be2b-cb939aedc8ea_del complete
Oct 20 12:17:09 user nova-compute[74241]: INFO nova.compute.manager [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Took 1.21 seconds to destroy the instance on the hypervisor.
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-b7a49e5f-a197-456d-a30f-79ffdbacea5e req-97034faf-31d2-49b4-980c-a17388155b09 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-changed-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.compute.manager [req-b7a49e5f-a197-456d-a30f-79ffdbacea5e req-97034faf-31d2-49b4-980c-a17388155b09 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Refreshing instance network info cache due to event network-changed-7d9fde9f-90f5-4236-82f6-2b8ff2598b01. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7a49e5f-a197-456d-a30f-79ffdbacea5e req-97034faf-31d2-49b4-980c-a17388155b09 service nova] Acquiring lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7a49e5f-a197-456d-a30f-79ffdbacea5e req-97034faf-31d2-49b4-980c-a17388155b09 service nova] Acquired lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG nova.network.neutron [req-b7a49e5f-a197-456d-a30f-79ffdbacea5e req-97034faf-31d2-49b4-980c-a17388155b09 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Refreshing network info cache for port 7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:10 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:17:10 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Took 0.43 seconds to deallocate network for instance.
Oct 20 12:17:10 user nova-compute[74241]: DEBUG nova.network.neutron [req-b7a49e5f-a197-456d-a30f-79ffdbacea5e req-97034faf-31d2-49b4-980c-a17388155b09 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updated VIF entry in instance network info cache for port 7d9fde9f-90f5-4236-82f6-2b8ff2598b01. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:17:10 user nova-compute[74241]: DEBUG nova.network.neutron [req-b7a49e5f-a197-456d-a30f-79ffdbacea5e req-97034faf-31d2-49b4-980c-a17388155b09 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updating instance_info_cache with network_info: [{"id": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "address": "fa:16:3e:77:15:77", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9fde9f-90", "ovs_interfaceid": "7d9fde9f-90f5-4236-82f6-2b8ff2598b01", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:17:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-989b3137-0b85-4712-ab64-a035ecf1f845 req-972f6e6c-d246-4875-aaf9-af1e8faff36b service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-deleted-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:10 user nova-compute[74241]: INFO nova.compute.manager [req-989b3137-0b85-4712-ab64-a035ecf1f845 req-972f6e6c-d246-4875-aaf9-af1e8faff36b service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Neutron deleted interface 7d9fde9f-90f5-4236-82f6-2b8ff2598b01; detaching it from the instance and deleting it from the info cache
Oct 20 12:17:10 user nova-compute[74241]: DEBUG nova.network.neutron [req-989b3137-0b85-4712-ab64-a035ecf1f845 req-972f6e6c-d246-4875-aaf9-af1e8faff36b service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:17:10 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-b7a49e5f-a197-456d-a30f-79ffdbacea5e req-97034faf-31d2-49b4-980c-a17388155b09 service nova] Releasing lock "refresh_cache-e2fafe88-71f6-4a40-be2b-cb939aedc8ea" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:17:10 user nova-compute[74241]: DEBUG nova.compute.manager [req-989b3137-0b85-4712-ab64-a035ecf1f845 req-972f6e6c-d246-4875-aaf9-af1e8faff36b service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Detach interface failed, port_id=7d9fde9f-90f5-4236-82f6-2b8ff2598b01, reason: Instance e2fafe88-71f6-4a40-be2b-cb939aedc8ea could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] No waiting events found dispatching network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:17:11 user nova-compute[74241]: WARNING nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received unexpected event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 for instance with vm_state active and task_state deleting.
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] No waiting events found dispatching network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:17:11 user nova-compute[74241]: WARNING nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received unexpected event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 for instance with vm_state active and task_state deleting.
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] No waiting events found dispatching network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:17:11 user nova-compute[74241]: WARNING nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received unexpected event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 for instance with vm_state active and task_state deleting.
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-unplugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] No waiting events found dispatching network-vif-unplugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-unplugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Acquiring lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] No waiting events found dispatching network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:17:11 user nova-compute[74241]: WARNING nova.compute.manager [req-6dd9ef10-a92a-49be-aa37-0d2f3a282614 req-7a7d6a15-d634-4db1-a01d-d9dfaa4b4792 service nova] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Received unexpected event network-vif-plugged-7d9fde9f-90f5-4236-82f6-2b8ff2598b01 for instance with vm_state active and task_state deleting.
Oct 20 12:17:11 user nova-compute[74241]: INFO nova.compute.manager [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: e2fafe88-71f6-4a40-be2b-cb939aedc8ea] Took 0.78 seconds to detach 1 volumes for instance.
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.158s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:11 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Deleted allocations for instance e2fafe88-71f6-4a40-be2b-cb939aedc8ea
Oct 20 12:17:11 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d4644ae7-d650-4800-92c5-3a290c27d1f8 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "e2fafe88-71f6-4a40-be2b-cb939aedc8ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.747s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:18 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 is timed out.
Oct 20 12:17:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully detached device vdc from instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 from the live domain config.
Oct 20 12:17:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JTobZUpm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:17:18 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e951ef1-1707-4153-8d80-5509ef45c112]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:17:18 user nova-compute[74241]: No targets found.
Oct 20 12:17:18 user nova-compute[74241]: iSNS:
Oct 20 12:17:18 user nova-compute[74241]: No targets found.
Oct 20 12:17:18 user nova-compute[74241]: STATIC:
Oct 20 12:17:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b
Oct 20 12:17:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:17:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:17:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976
Oct 20 12:17:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:17:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:17:18 user nova-compute[74241]: FIRMWARE:
Oct 20 12:17:18 user nova-compute[74241]: No targets found.
Oct 20 12:17:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:17:18 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:17:18 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8f93f4-8d60-47c2-a6cd-3dca37dcee32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63bf8b3-c3cd-4c6a-bce4-efd152e4d102]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:17:18 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:17:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:17:18 user nova-compute[74241]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 (non-flash)
Oct 20 12:17:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52283b72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e33cc4f-6539-45c0-bdcf-5f2adda99f79]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a37d51e-9e1d-4cac-9770-a2d68238308d]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[704daf83-d13a-423c-9c1d-1cbf2b67bb84]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724caff-0ce0-45e5-9ff5-782700350fa8]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe262b42-6f67-4eb0-b769-554be3c6cde5]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b13bff4-38cf-4fc5-8058-88f8b6ea26eb]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976, portal: 172.16.0.220,3260]
Oct 20 12:17:18 user nova-compute[74241]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976, portal: 172.16.0.220,3260] successful.
Oct 20 12:17:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ade2b124-a620-41e7-a735-c575b1e6a976 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86b18fd-946b-431f-9fbb-28e5861387ad]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] <== disconnect_volume: return (313ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:18 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:17:19 user nova-compute[74241]: DEBUG nova.objects.instance [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'flavor' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:17:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1172f167-8e58-4f0d-a6e6-379f130a819f tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.741s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:25 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:17:26 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:17:26 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:17:26 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=25.14522933959961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 3852f29a-2048-49b5-a381-2fba26f56bc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:17:26 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:27 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:17:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:29 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:17:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:17:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:17:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:17:29 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:17:29 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 3852f29a-2048-49b5-a381-2fba26f56bc0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:17:30 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:17:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:17:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:17:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:33 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:17:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:17:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:17:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:48 user nova-compute[74241]: INFO nova.compute.manager [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Terminating instance
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.compute.manager [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-db302660-59a9-48d4-93eb-222cb52e30a5 req-8bb3499d-2df4-4f17-b675-b004e90855bd service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-unplugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db302660-59a9-48d4-93eb-222cb52e30a5 req-8bb3499d-2df4-4f17-b675-b004e90855bd service nova] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db302660-59a9-48d4-93eb-222cb52e30a5 req-8bb3499d-2df4-4f17-b675-b004e90855bd service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-db302660-59a9-48d4-93eb-222cb52e30a5 req-8bb3499d-2df4-4f17-b675-b004e90855bd service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-db302660-59a9-48d4-93eb-222cb52e30a5 req-8bb3499d-2df4-4f17-b675-b004e90855bd service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] No waiting events found dispatching network-vif-unplugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.compute.manager [req-db302660-59a9-48d4-93eb-222cb52e30a5 req-8bb3499d-2df4-4f17-b675-b004e90855bd service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-unplugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:17:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Instance destroyed successfully.
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.objects.instance [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'resources' on Instance uuid e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1714880826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1714880826',id=48,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAg8zolpwnYuhbipksullvjxavUppQCzJmI7GxZvSyqVFkY6dDfsYAFmkEPJENJugHLEct0USovu2bJ1naza0TqerrEcrTWowvI3fj63Qx1MmPy31UqKbey2qGdXeSlZA==',key_name='tempest-keypair-936351467',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:15:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ja2tzwwy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:15:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "address": "fa:16:3e:3f:47:e0", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5abd04-e0", "ovs_interfaceid": "1e5abd04-e0a2-45d3-b060-3a3698250e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG os_vif [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e5abd04-e0, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7106aa62-b78c-4c8e-8769-c16764183cde) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:48 user nova-compute[74241]: INFO os_vif [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:47:e0,bridge_name='br-int',has_traffic_filtering=True,id=1e5abd04-e0a2-45d3-b060-3a3698250e7a,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5abd04-e0')
Oct 20 12:17:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Deleting instance files /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2_del
Oct 20 12:17:48 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Deletion of /opt/stack/data/nova/instances/e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2_del complete
Oct 20 12:17:48 user nova-compute[74241]: INFO nova.compute.manager [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 12:17:48 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:17:48 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:17:50 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Took 1.28 seconds to deallocate network for instance.
Oct 20 12:17:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-93ca4086-0fbd-447e-b1c0-763fa53fd580 req-5c7a7701-9a77-4bec-8619-403a70624106 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93ca4086-0fbd-447e-b1c0-763fa53fd580 req-5c7a7701-9a77-4bec-8619-403a70624106 service nova] Acquiring lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93ca4086-0fbd-447e-b1c0-763fa53fd580 req-5c7a7701-9a77-4bec-8619-403a70624106 service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-93ca4086-0fbd-447e-b1c0-763fa53fd580 req-5c7a7701-9a77-4bec-8619-403a70624106 service nova] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-93ca4086-0fbd-447e-b1c0-763fa53fd580 req-5c7a7701-9a77-4bec-8619-403a70624106 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] No waiting events found dispatching network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:17:50 user nova-compute[74241]: WARNING nova.compute.manager [req-93ca4086-0fbd-447e-b1c0-763fa53fd580 req-5c7a7701-9a77-4bec-8619-403a70624106 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received unexpected event network-vif-plugged-1e5abd04-e0a2-45d3-b060-3a3698250e7a for instance with vm_state deleted and task_state None.
Oct 20 12:17:50 user nova-compute[74241]: DEBUG nova.compute.manager [req-93ca4086-0fbd-447e-b1c0-763fa53fd580 req-5c7a7701-9a77-4bec-8619-403a70624106 service nova] [instance: e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2] Received event network-vif-deleted-1e5abd04-e0a2-45d3-b060-3a3698250e7a {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:17:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:50 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Deleted allocations for instance e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2
Oct 20 12:17:50 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-d0282f09-d077-47e0-963d-a3577a34a656 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "e9a5cb2e-8f57-470c-bdb1-0c8eb97532e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:17:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:17:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:17:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:17:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:17:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:17:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-95687859-f936-470b-aa4b-d05387fc17bb req-b902367b-cae8-4b14-b991-9d9e920f6761 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-changed-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG nova.compute.manager [req-95687859-f936-470b-aa4b-d05387fc17bb req-b902367b-cae8-4b14-b991-9d9e920f6761 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Refreshing instance network info cache due to event network-changed-b4d15b2b-b7d8-492a-822b-63074d420ac9. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95687859-f936-470b-aa4b-d05387fc17bb req-b902367b-cae8-4b14-b991-9d9e920f6761 service nova] Acquiring lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95687859-f936-470b-aa4b-d05387fc17bb req-b902367b-cae8-4b14-b991-9d9e920f6761 service nova] Acquired lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG nova.network.neutron [req-95687859-f936-470b-aa4b-d05387fc17bb req-b902367b-cae8-4b14-b991-9d9e920f6761 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Refreshing network info cache for port b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "3852f29a-2048-49b5-a381-2fba26f56bc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:17 user nova-compute[74241]: INFO nova.compute.manager [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Terminating instance
Oct 20 12:18:17 user nova-compute[74241]: DEBUG nova.compute.manager [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-95687859-f936-470b-aa4b-d05387fc17bb req-b902367b-cae8-4b14-b991-9d9e920f6761 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updated VIF entry in instance network info cache for port b4d15b2b-b7d8-492a-822b-63074d420ac9. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.network.neutron [req-95687859-f936-470b-aa4b-d05387fc17bb req-b902367b-cae8-4b14-b991-9d9e920f6761 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [{"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-95687859-f936-470b-aa4b-d05387fc17bb req-b902367b-cae8-4b14-b991-9d9e920f6761 service nova] Releasing lock "refresh_cache-3852f29a-2048-49b5-a381-2fba26f56bc0" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:18:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Instance destroyed successfully.
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.objects.instance [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lazy-loading 'resources' on Instance uuid 3852f29a-2048-49b5-a381-2fba26f56bc0 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:13:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-996765420',display_name='tempest-TestVolumeBootPattern-server-996765420',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-996765420',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEynWa1h7Mp5Yy4YvC5liqY9+RYFBHxARrLlGRdmhlKVNKeIQJFW3oIOcYPEMAqFsbE9b/xSMB3cjLzjD6YTMeeRhef3Ncp+2v3OW1xNXloZbcZs7PZh0jUhabDY7O5d2Q==',key_name='tempest-TestVolumeBootPattern-516899942',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:13:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6744161987c43408e35c847ec2055a5',ramdisk_id='',reservation_id='r-6p0cy6lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-71867186',owner_user_name='tempest-TestVolumeBootPattern-71867186-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:13:30Z,user_data=None,user_id='bf5346976b7f45e1b146911555f458eb',uuid=3852f29a-2048-49b5-a381-2fba26f56bc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converting VIF {"id": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "address": "fa:16:3e:ad:88:ea", "network": {"id": "4f6b722f-ab4f-43cd-841c-b69412f3f7ba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1432623922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6744161987c43408e35c847ec2055a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4d15b2b-b7", "ovs_interfaceid": "b4d15b2b-b7d8-492a-822b-63074d420ac9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:88:ea,bridge_name='br-int',has_traffic_filtering=True,id=b4d15b2b-b7d8-492a-822b-63074d420ac9,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4d15b2b-b7') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_vif [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:88:ea,bridge_name='br-int',has_traffic_filtering=True,id=b4d15b2b-b7d8-492a-822b-63074d420ac9,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4d15b2b-b7') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4d15b2b-b7, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ac96c76-0bb4-4765-9a49-92aeb0a38746) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:18 user nova-compute[74241]: INFO os_vif [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:88:ea,bridge_name='br-int',has_traffic_filtering=True,id=b4d15b2b-b7d8-492a-822b-63074d420ac9,network=Network(4f6b722f-ab4f-43cd-841c-b69412f3f7ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4d15b2b-b7')
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AhLoSmZY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:18:18 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ca8f75-0e62-4a87-9e40-cac18778f31b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:18:18 user nova-compute[74241]: No targets found.
Oct 20 12:18:18 user nova-compute[74241]: iSNS:
Oct 20 12:18:18 user nova-compute[74241]: No targets found.
Oct 20 12:18:18 user nova-compute[74241]: STATIC:
Oct 20 12:18:18 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b
Oct 20 12:18:18 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:18:18 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:18:18 user nova-compute[74241]: FIRMWARE:
Oct 20 12:18:18 user nova-compute[74241]: No targets found.
Oct 20 12:18:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:18:18 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:18:18 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb70d16-b00d-4bea-883d-3efa3717b514]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dba58b-b67f-447f-8a9e-f92b8f18820f]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:18:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b (non-flash)
Oct 20 12:18:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52084cb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e9a43b-5571-4699-a5ec-a859ac095a26]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f53a44-a056-4822-9536-63c0e8b6cbec]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40db01b-b638-4e2e-9364-577a0f418960]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc13fa6-767b-476a-806e-3f5c15bb9f73]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c2e95b-bc09-4820-91a0-a2eaa9f23387]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa5df8b-9d3d-4c52-858d-a01677a6eb5e]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260]
Oct 20 12:18:18 user nova-compute[74241]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b, portal: 172.16.0.220,3260] successful.
Oct 20 12:18:18 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c6494fa-3a8a-49f6-87d9-ee9cd4d38f8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ca64e-156f-4df5-b8ba-468d3bcdec14]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] <== disconnect_volume: return (291ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:18:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Deleting instance files /opt/stack/data/nova/instances/3852f29a-2048-49b5-a381-2fba26f56bc0_del
Oct 20 12:18:18 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Deletion of /opt/stack/data/nova/instances/3852f29a-2048-49b5-a381-2fba26f56bc0_del complete
Oct 20 12:18:18 user nova-compute[74241]: INFO nova.compute.manager [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Took 1.14 seconds to destroy the instance on the hypervisor.
Oct 20 12:18:18 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:18:18 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:18:19 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Took 0.49 seconds to deallocate network for instance.
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-84464082-d3b7-493e-9f5c-f97cc39eeb96 req-3e7b3cb1-6eec-4266-8a39-15122b7fe4d3 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-vif-deleted-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:18:19 user nova-compute[74241]: INFO nova.compute.manager [req-84464082-d3b7-493e-9f5c-f97cc39eeb96 req-3e7b3cb1-6eec-4266-8a39-15122b7fe4d3 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Neutron deleted interface b4d15b2b-b7d8-492a-822b-63074d420ac9; detaching it from the instance and deleting it from the info cache
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.network.neutron [req-84464082-d3b7-493e-9f5c-f97cc39eeb96 req-3e7b3cb1-6eec-4266-8a39-15122b7fe4d3 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-84464082-d3b7-493e-9f5c-f97cc39eeb96 req-3e7b3cb1-6eec-4266-8a39-15122b7fe4d3 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Detach interface failed, port_id=b4d15b2b-b7d8-492a-822b-63074d420ac9, reason: Instance 3852f29a-2048-49b5-a381-2fba26f56bc0 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-vif-unplugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] Acquiring lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] No waiting events found dispatching network-vif-unplugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-vif-unplugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received event network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] Acquiring lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:19 user nova-compute[74241]: DEBUG nova.compute.manager [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] No waiting events found dispatching network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:18:19 user nova-compute[74241]: WARNING nova.compute.manager [req-63f8e488-ab71-4af3-a824-88acda12b099 req-8c42ad93-0e2b-434d-8135-159926bf4f08 service nova] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Received unexpected event network-vif-plugged-b4d15b2b-b7d8-492a-822b-63074d420ac9 for instance with vm_state active and task_state deleting.
Oct 20 12:18:20 user nova-compute[74241]: INFO nova.compute.manager [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] [instance: 3852f29a-2048-49b5-a381-2fba26f56bc0] Took 0.95 seconds to detach 1 volumes for instance.
Oct 20 12:18:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:20 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:18:20 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:18:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:20 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Deleted allocations for instance 3852f29a-2048-49b5-a381-2fba26f56bc0
Oct 20 12:18:20 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-0f777557-ab0d-46ac-9799-e88f66092f27 tempest-TestVolumeBootPattern-71867186 tempest-TestVolumeBootPattern-71867186-project-member] Lock "3852f29a-2048-49b5-a381-2fba26f56bc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.860s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:20 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:27 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:27 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:27 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:18:28 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:18:28 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:18:28 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9085MB free_disk=25.172203063964844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:29 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:18:29 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:18:29 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 12:18:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:18:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:18:42 user nova-compute[74241]: INFO nova.compute.claims [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Claim successful on node user
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:18:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.policy [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a5402b24624c44ae88239677c5778850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3600c43897b483fb6ed35091763bc01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:18:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Creating image(s)
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.182s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:42 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.184s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk 1073741824" returned: 0 in 0.052s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Successfully created port: 36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Cannot resize image /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Ensure instance console log exists: /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Successfully updated port: 36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-473dccac-8dce-4f99-80bd-45c15a8f38f7 req-dd33cdeb-b65f-4c44-b15c-292e215f5d9f service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-changed-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-473dccac-8dce-4f99-80bd-45c15a8f38f7 req-dd33cdeb-b65f-4c44-b15c-292e215f5d9f service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Refreshing instance network info cache due to event network-changed-36923475-e160-4b6c-9695-f2a7d4db09fc. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-473dccac-8dce-4f99-80bd-45c15a8f38f7 req-dd33cdeb-b65f-4c44-b15c-292e215f5d9f service nova] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:18:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.network.neutron [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance network_info: |[{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-473dccac-8dce-4f99-80bd-45c15a8f38f7 req-dd33cdeb-b65f-4c44-b15c-292e215f5d9f service nova] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-473dccac-8dce-4f99-80bd-45c15a8f38f7 req-dd33cdeb-b65f-4c44-b15c-292e215f5d9f service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Refreshing network info cache for port 36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Start _get_guest_xml network_info=[{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:18:44 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:18:44 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2031761672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2031761672',id=51,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQo+mmCIHcBMBUgc2CLCnwjkDbgDJyAaWgAnK+u47TycTX9rpIkf2WcDuq4UXHnr6T/QXbhRsB8UsPW0O43cgq+HzeH3NLLSfElBPEy98I974Ye9xtviMSFK8uzeG9ybA==',key_name='tempest-keypair-423527967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ttzoeyt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:18:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=4f9bc082-5a0c-4d38-a525-c83d4f42df31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.objects.instance [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:18:44 user nova-compute[74241]:   <uuid>4f9bc082-5a0c-4d38-a525-c83d4f42df31</uuid>
Oct 20 12:18:44 user nova-compute[74241]:   <name>instance-00000033</name>
Oct 20 12:18:44 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:18:44 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:18:44 user nova-compute[74241]:   <metadata>
Oct 20 12:18:44 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:18:44 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:18:44 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2031761672</nova:name>
Oct 20 12:18:44 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:18:44</nova:creationTime>
Oct 20 12:18:44 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:18:44 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:18:44 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:18:44 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:18:44 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:18:44 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:18:44 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:18:44 user nova-compute[74241]:       <nova:owner>
Oct 20 12:18:44 user nova-compute[74241]:         <nova:user uuid="a5402b24624c44ae88239677c5778850">tempest-AttachVolumeShelveTestJSON-882980696-project-member</nova:user>
Oct 20 12:18:44 user nova-compute[74241]:         <nova:project uuid="f3600c43897b483fb6ed35091763bc01">tempest-AttachVolumeShelveTestJSON-882980696</nova:project>
Oct 20 12:18:44 user nova-compute[74241]:       </nova:owner>
Oct 20 12:18:44 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 12:18:44 user nova-compute[74241]:       <nova:ports>
Oct 20 12:18:44 user nova-compute[74241]:         <nova:port uuid="36923475-e160-4b6c-9695-f2a7d4db09fc">
Oct 20 12:18:44 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 12:18:44 user nova-compute[74241]:         </nova:port>
Oct 20 12:18:44 user nova-compute[74241]:       </nova:ports>
Oct 20 12:18:44 user nova-compute[74241]:     </nova:instance>
Oct 20 12:18:44 user nova-compute[74241]:   </metadata>
Oct 20 12:18:44 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:18:44 user nova-compute[74241]:     <system>
Oct 20 12:18:44 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:18:44 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:18:44 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:18:44 user nova-compute[74241]:       <entry name="serial">4f9bc082-5a0c-4d38-a525-c83d4f42df31</entry>
Oct 20 12:18:44 user nova-compute[74241]:       <entry name="uuid">4f9bc082-5a0c-4d38-a525-c83d4f42df31</entry>
Oct 20 12:18:44 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:18:44 user nova-compute[74241]:     </system>
Oct 20 12:18:44 user nova-compute[74241]:   </sysinfo>
Oct 20 12:18:44 user nova-compute[74241]:   <os>
Oct 20 12:18:44 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:18:44 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:18:44 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:18:44 user nova-compute[74241]:   </os>
Oct 20 12:18:44 user nova-compute[74241]:   <features>
Oct 20 12:18:44 user nova-compute[74241]:     <acpi/>
Oct 20 12:18:44 user nova-compute[74241]:     <apic/>
Oct 20 12:18:44 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:18:44 user nova-compute[74241]:   </features>
Oct 20 12:18:44 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:18:44 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:18:44 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:18:44 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:18:44 user nova-compute[74241]:   </clock>
Oct 20 12:18:44 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:18:44 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:18:44 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:18:44 user nova-compute[74241]:   </cpu>
Oct 20 12:18:44 user nova-compute[74241]:   <devices>
Oct 20 12:18:44 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:18:44 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:18:44 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk"/>
Oct 20 12:18:44 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:18:44 user nova-compute[74241]:     </disk>
Oct 20 12:18:44 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:18:44 user nova-compute[74241]:       <mac address="fa:16:3e:2f:b9:93"/>
Oct 20 12:18:44 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:18:44 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:18:44 user nova-compute[74241]:       <target dev="tap36923475-e1"/>
Oct 20 12:18:44 user nova-compute[74241]:     </interface>
Oct 20 12:18:44 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:18:44 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/console.log" append="off"/>
Oct 20 12:18:44 user nova-compute[74241]:     </serial>
Oct 20 12:18:44 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:18:44 user nova-compute[74241]:     <video>
Oct 20 12:18:44 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:18:44 user nova-compute[74241]:     </video>
Oct 20 12:18:44 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:18:44 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:18:44 user nova-compute[74241]:     </rng>
Oct 20 12:18:44 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:18:44 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:18:44 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:18:44 user nova-compute[74241]:     </memballoon>
Oct 20 12:18:44 user nova-compute[74241]:   </devices>
Oct 20 12:18:44 user nova-compute[74241]: </domain>
Oct 20 12:18:44 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2031761672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2031761672',id=51,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQo+mmCIHcBMBUgc2CLCnwjkDbgDJyAaWgAnK+u47TycTX9rpIkf2WcDuq4UXHnr6T/QXbhRsB8UsPW0O43cgq+HzeH3NLLSfElBPEy98I974Ye9xtviMSFK8uzeG9ybA==',key_name='tempest-keypair-423527967',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ttzoeyt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:18:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=4f9bc082-5a0c-4d38-a525-c83d4f42df31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG os_vif [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1b1de92-b31b-59cd-8fed-180640a3729f', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36923475-e1, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36923475-e1, col_values=(('qos', UUID('ec3763d2-e4c1-4400-9840-20e64bef949e')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36923475-e1, col_values=(('external_ids', {'iface-id': '36923475-e160-4b6c-9695-f2a7d4db09fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:b9:93', 'vm-uuid': '4f9bc082-5a0c-4d38-a525-c83d4f42df31'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:44 user nova-compute[74241]: INFO os_vif [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1')
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No VIF found with MAC fa:16:3e:2f:b9:93, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-473dccac-8dce-4f99-80bd-45c15a8f38f7 req-dd33cdeb-b65f-4c44-b15c-292e215f5d9f service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updated VIF entry in instance network info cache for port 36923475-e160-4b6c-9695-f2a7d4db09fc. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-473dccac-8dce-4f99-80bd-45c15a8f38f7 req-dd33cdeb-b65f-4c44-b15c-292e215f5d9f service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:18:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-473dccac-8dce-4f99-80bd-45c15a8f38f7 req-dd33cdeb-b65f-4c44-b15c-292e215f5d9f service nova] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:18:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-e185a946-2334-4f38-8c00-c9227689cd42 req-60e8a240-0d15-4e1a-bc96-ff2acf8a7a6b service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:18:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e185a946-2334-4f38-8c00-c9227689cd42 req-60e8a240-0d15-4e1a-bc96-ff2acf8a7a6b service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e185a946-2334-4f38-8c00-c9227689cd42 req-60e8a240-0d15-4e1a-bc96-ff2acf8a7a6b service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e185a946-2334-4f38-8c00-c9227689cd42 req-60e8a240-0d15-4e1a-bc96-ff2acf8a7a6b service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-e185a946-2334-4f38-8c00-c9227689cd42 req-60e8a240-0d15-4e1a-bc96-ff2acf8a7a6b service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:18:45 user nova-compute[74241]: WARNING nova.compute.manager [req-e185a946-2334-4f38-8c00-c9227689cd42 req-60e8a240-0d15-4e1a-bc96-ff2acf8a7a6b service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state building and task_state spawning.
Oct 20 12:18:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:18:47 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance spawned successfully.
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:18:47 user nova-compute[74241]: INFO nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Took 5.22 seconds to spawn the instance on the hypervisor.
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-22dd1ed8-6bed-4928-91b5-10de1c37fdb1 req-08ce0ad7-088c-4af3-995d-74b6aed83f9e service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22dd1ed8-6bed-4928-91b5-10de1c37fdb1 req-08ce0ad7-088c-4af3-995d-74b6aed83f9e service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22dd1ed8-6bed-4928-91b5-10de1c37fdb1 req-08ce0ad7-088c-4af3-995d-74b6aed83f9e service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-22dd1ed8-6bed-4928-91b5-10de1c37fdb1 req-08ce0ad7-088c-4af3-995d-74b6aed83f9e service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-22dd1ed8-6bed-4928-91b5-10de1c37fdb1 req-08ce0ad7-088c-4af3-995d-74b6aed83f9e service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:18:47 user nova-compute[74241]: WARNING nova.compute.manager [req-22dd1ed8-6bed-4928-91b5-10de1c37fdb1 req-08ce0ad7-088c-4af3-995d-74b6aed83f9e service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state building and task_state spawning.
Oct 20 12:18:48 user nova-compute[74241]: INFO nova.compute.manager [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Took 6.01 seconds to build instance.
Oct 20 12:18:48 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-1ca04382-89a1-4130-906b-29eebafa20e1 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.166s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:18:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:18:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:21 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:28 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:19:29 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:19:30 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:19:30 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:19:30 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=25.133861541748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 4f9bc082-5a0c-4d38-a525-c83d4f42df31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:19:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:19:31 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:19:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:19:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:19:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:19:31 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:19:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:19:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:19:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:19:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:19:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:34 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 12:19:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 12:19:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:19:49 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:19:54 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:19:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:58 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 12:19:58 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:19:59 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:20:04 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:09 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:20:14 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:19 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:21 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:22 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:23 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:24 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:29 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:20:30 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:20:31 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:20:31 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8997MB free_disk=25.132766723632812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 4f9bc082-5a0c-4d38-a525-c83d4f42df31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:20:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-39cef7c2-615b-412c-9199-e1e735f90427 req-9e6fe446-84a9-4d7a-b26e-888e868d522d service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-changed-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-39cef7c2-615b-412c-9199-e1e735f90427 req-9e6fe446-84a9-4d7a-b26e-888e868d522d service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Refreshing instance network info cache due to event network-changed-36923475-e160-4b6c-9695-f2a7d4db09fc. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39cef7c2-615b-412c-9199-e1e735f90427 req-9e6fe446-84a9-4d7a-b26e-888e868d522d service nova] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39cef7c2-615b-412c-9199-e1e735f90427 req-9e6fe446-84a9-4d7a-b26e-888e868d522d service nova] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-39cef7c2-615b-412c-9199-e1e735f90427 req-9e6fe446-84a9-4d7a-b26e-888e868d522d service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Refreshing network info cache for port 36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-39cef7c2-615b-412c-9199-e1e735f90427 req-9e6fe446-84a9-4d7a-b26e-888e868d522d service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updated VIF entry in instance network info cache for port 36923475-e160-4b6c-9695-f2a7d4db09fc. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-39cef7c2-615b-412c-9199-e1e735f90427 req-9e6fe446-84a9-4d7a-b26e-888e868d522d service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-39cef7c2-615b-412c-9199-e1e735f90427 req-9e6fe446-84a9-4d7a-b26e-888e868d522d service nova] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:20:33 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:20:34 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:20:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:20:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:20:34 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:20:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:20:38 user nova-compute[74241]: INFO nova.compute.manager [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Shelving
Oct 20 12:20:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-c1e16c13-ec14-4bd6-b9a3-922e9cc72c4a req-79eb882c-bfed-4e4b-b833-4bff0849398c service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1e16c13-ec14-4bd6-b9a3-922e9cc72c4a req-79eb882c-bfed-4e4b-b833-4bff0849398c service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1e16c13-ec14-4bd6-b9a3-922e9cc72c4a req-79eb882c-bfed-4e4b-b833-4bff0849398c service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-c1e16c13-ec14-4bd6-b9a3-922e9cc72c4a req-79eb882c-bfed-4e4b-b833-4bff0849398c service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-c1e16c13-ec14-4bd6-b9a3-922e9cc72c4a req-79eb882c-bfed-4e4b-b833-4bff0849398c service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:20:39 user nova-compute[74241]: WARNING nova.compute.manager [req-c1e16c13-ec14-4bd6-b9a3-922e9cc72c4a req-79eb882c-bfed-4e4b-b833-4bff0849398c service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state active and task_state shelving.
Oct 20 12:20:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance destroyed successfully.
Oct 20 12:20:39 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Beginning cold snapshot process
Oct 20 12:20:39 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 12:20:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk /opt/stack/data/nova/instances/snapshots/tmppoxrtjjw/0ae3981d51384c7d8412f8a522bdc20d {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:20:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk /opt/stack/data/nova/instances/snapshots/tmppoxrtjjw/0ae3981d51384c7d8412f8a522bdc20d" returned: 0 in 0.557s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:20:40 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Snapshot extracted, beginning image upload
Oct 20 12:20:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-6541bd42-4fe4-41b8-923c-3d5cbe292ab9 req-e1c8c650-ad5b-4fd8-998b-6d78262e8f1a service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:20:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6541bd42-4fe4-41b8-923c-3d5cbe292ab9 req-e1c8c650-ad5b-4fd8-998b-6d78262e8f1a service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:20:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6541bd42-4fe4-41b8-923c-3d5cbe292ab9 req-e1c8c650-ad5b-4fd8-998b-6d78262e8f1a service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:20:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6541bd42-4fe4-41b8-923c-3d5cbe292ab9 req-e1c8c650-ad5b-4fd8-998b-6d78262e8f1a service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:20:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-6541bd42-4fe4-41b8-923c-3d5cbe292ab9 req-e1c8c650-ad5b-4fd8-998b-6d78262e8f1a service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:20:41 user nova-compute[74241]: WARNING nova.compute.manager [req-6541bd42-4fe4-41b8-923c-3d5cbe292ab9 req-e1c8c650-ad5b-4fd8-998b-6d78262e8f1a service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 12:20:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Snapshot image upload complete
Oct 20 12:20:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:20:42 user nova-compute[74241]: INFO nova.compute.manager [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Shelve offloading
Oct 20 12:20:42 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance destroyed successfully.
Oct 20 12:20:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:20:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:20:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:20:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.network.neutron [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:43 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance destroyed successfully.
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'resources' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2031761672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2031761672',id=51,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQo+mmCIHcBMBUgc2CLCnwjkDbgDJyAaWgAnK+u47TycTX9rpIkf2WcDuq4UXHnr6T/QXbhRsB8UsPW0O43cgq+HzeH3NLLSfElBPEy98I974Ye9xtviMSFK8uzeG9ybA==',key_name='tempest-keypair-423527967',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ttzoeyt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member',shelved_at='2023-10-20T12:20:42.749021',shelved_host='user',shelved_image_id='9251735c-4454-4678-a835-c482dd85352d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:20:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=4f9bc082-5a0c-4d38-a525-c83d4f42df31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG os_vif [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36923475-e1, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-e66f8774-e5b5-455c-b4c3-5f2b74caa0ac req-fdd9e06c-468e-469f-b51d-b8dfb55c30c8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-changed-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.compute.manager [req-e66f8774-e5b5-455c-b4c3-5f2b74caa0ac req-fdd9e06c-468e-469f-b51d-b8dfb55c30c8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Refreshing instance network info cache due to event network-changed-36923475-e160-4b6c-9695-f2a7d4db09fc. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e66f8774-e5b5-455c-b4c3-5f2b74caa0ac req-fdd9e06c-468e-469f-b51d-b8dfb55c30c8 service nova] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e66f8774-e5b5-455c-b4c3-5f2b74caa0ac req-fdd9e06c-468e-469f-b51d-b8dfb55c30c8 service nova] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.network.neutron [req-e66f8774-e5b5-455c-b4c3-5f2b74caa0ac req-fdd9e06c-468e-469f-b51d-b8dfb55c30c8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Refreshing network info cache for port 36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec3763d2-e4c1-4400-9840-20e64bef949e) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:20:43 user nova-compute[74241]: INFO os_vif [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1')
Oct 20 12:20:43 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Deleting instance files /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31_del
Oct 20 12:20:43 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Deletion of /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31_del complete
Oct 20 12:20:43 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Deleted allocations for instance 4f9bc082-5a0c-4d38-a525-c83d4f42df31
Oct 20 12:20:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.objects.instance [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.objects.base [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<4f9bc082-5a0c-4d38-a525-c83d4f42df31> lazy-loaded attributes: resources,numa_topology {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:20:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.092s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:20:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-f6ae1514-6a80-4c38-975c-b3014f3612b4 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.150s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:20:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-e66f8774-e5b5-455c-b4c3-5f2b74caa0ac req-fdd9e06c-468e-469f-b51d-b8dfb55c30c8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updated VIF entry in instance network info cache for port 36923475-e160-4b6c-9695-f2a7d4db09fc. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:20:44 user nova-compute[74241]: DEBUG nova.network.neutron [req-e66f8774-e5b5-455c-b4c3-5f2b74caa0ac req-fdd9e06c-468e-469f-b51d-b8dfb55c30c8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap36923475-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:20:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-e66f8774-e5b5-455c-b4c3-5f2b74caa0ac req-fdd9e06c-468e-469f-b51d-b8dfb55c30c8 service nova] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:20:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:20:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:20:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:20:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:20:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:20:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:20:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:20:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:20:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:20:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:20:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:21:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:23 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:21:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:21:31 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:21:32 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:21:33 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:21:33 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:21:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.110916137695312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:21:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:37 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:21:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:21:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:21:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:21:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:21:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:21:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:21:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:22:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:22:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:22:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:22:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:22:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:22:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:24 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:25 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:22:31 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:31 user nova-compute[74241]: INFO nova.compute.manager [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Unshelving
Oct 20 12:22:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'pci_requests' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:22:31 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:22:31 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:22:31 user nova-compute[74241]: INFO nova.compute.claims [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Claim successful on node user
Oct 20 12:22:32 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:32 user nova-compute[74241]: INFO nova.network.neutron [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating port 36923475-e160-4b6c-9695-f2a7d4db09fc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:32 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-8b742106-fc42-46c3-88b9-e7c2ba34468b req-97fc9cab-9b43-42b2-9ee4-0d13b4a27ee8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-changed-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.compute.manager [req-8b742106-fc42-46c3-88b9-e7c2ba34468b req-97fc9cab-9b43-42b2-9ee4-0d13b4a27ee8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Refreshing instance network info cache due to event network-changed-36923475-e160-4b6c-9695-f2a7d4db09fc. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8b742106-fc42-46c3-88b9-e7c2ba34468b req-97fc9cab-9b43-42b2-9ee4-0d13b4a27ee8 service nova] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:22:33 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:22:33 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9149MB free_disk=25.110145568847656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (34e63c41-61c0-494b-ac17-d5bfda3fa5f2): {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.network.neutron [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:22:33 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Creating image(s)
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8b742106-fc42-46c3-88b9-e7c2ba34468b req-97fc9cab-9b43-42b2-9ee4-0d13b4a27ee8 service nova] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-8b742106-fc42-46c3-88b9-e7c2ba34468b req-97fc9cab-9b43-42b2-9ee4-0d13b4a27ee8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Refreshing network info cache for port 36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG nova.objects.base [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<4f9bc082-5a0c-4d38-a525-c83d4f42df31> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "6749056aff2498fed6fe957c6b11d7335a911b2d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "6749056aff2498fed6fe957c6b11d7335a911b2d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d.part --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d.part --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG nova.virt.images [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] 9251735c-4454-4678-a835-c482dd85352d was qcow2, converting to raw {{(pid=74241) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG nova.privsep.utils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74241) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d.part /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d.converted {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG nova.network.neutron [req-8b742106-fc42-46c3-88b9-e7c2ba34468b req-97fc9cab-9b43-42b2-9ee4-0d13b4a27ee8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updated VIF entry in instance network info cache for port 36923475-e160-4b6c-9695-f2a7d4db09fc. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG nova.network.neutron [req-8b742106-fc42-46c3-88b9-e7c2ba34468b req-97fc9cab-9b43-42b2-9ee4-0d13b4a27ee8 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-8b742106-fc42-46c3-88b9-e7c2ba34468b req-97fc9cab-9b43-42b2-9ee4-0d13b4a27ee8 service nova] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d.part /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d.converted" returned: 0 in 0.223s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d.converted --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "6749056aff2498fed6fe957c6b11d7335a911b2d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.645s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d --force-share --output=json" returned: 0 in 0.169s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "6749056aff2498fed6fe957c6b11d7335a911b2d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "6749056aff2498fed6fe957c6b11d7335a911b2d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d --force-share --output=json" returned: 0 in 0.173s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d,backing_fmt=raw /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d,backing_fmt=raw /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk 1073741824" returned: 0 in 0.051s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "6749056aff2498fed6fe957c6b11d7335a911b2d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6749056aff2498fed6fe957c6b11d7335a911b2d --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'migration_context' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG nova.objects.base [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<4f9bc082-5a0c-4d38-a525-c83d4f42df31> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:22:35 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Rebasing disk image.
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 -F raw /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 -F raw /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk" returned: 0 in 1.932s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Ensure instance console log exists: /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Start _get_guest_xml network_info=[{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d7dd047d3bfbc2accb29d303eadb4569',container_format='bare',created_at=2023-10-20T12:20:39Z,direct_url=<?>,disk_format='qcow2',id=9251735c-4454-4678-a835-c482dd85352d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2031761672-shelved',owner='f3600c43897b483fb6ed35091763bc01',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T12:20:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:22:37 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:22:37 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d7dd047d3bfbc2accb29d303eadb4569',container_format='bare',created_at=2023-10-20T12:20:39Z,direct_url=<?>,disk_format='qcow2',id=9251735c-4454-4678-a835-c482dd85352d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2031761672-shelved',owner='f3600c43897b483fb6ed35091763bc01',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T12:20:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.objects.base [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<4f9bc082-5a0c-4d38-a525-c83d4f42df31> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2031761672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2031761672',id=51,image_ref='9251735c-4454-4678-a835-c482dd85352d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-423527967',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ttzoeyt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member',shelved_at='2023-10-20T12:20:42.749021',shelved_host='user',shelved_image_id='9251735c-4454-4678-a835-c482dd85352d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=4f9bc082-5a0c-4d38-a525-c83d4f42df31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.objects.instance [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.objects.base [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Object Instance<4f9bc082-5a0c-4d38-a525-c83d4f42df31> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74241) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:22:37 user nova-compute[74241]:   <uuid>4f9bc082-5a0c-4d38-a525-c83d4f42df31</uuid>
Oct 20 12:22:37 user nova-compute[74241]:   <name>instance-00000033</name>
Oct 20 12:22:37 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:22:37 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:22:37 user nova-compute[74241]:   <metadata>
Oct 20 12:22:37 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:22:37 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:22:37 user nova-compute[74241]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2031761672</nova:name>
Oct 20 12:22:37 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:22:37</nova:creationTime>
Oct 20 12:22:37 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:22:37 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:22:37 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:22:37 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:22:37 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:22:37 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:22:37 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:22:37 user nova-compute[74241]:       <nova:owner>
Oct 20 12:22:37 user nova-compute[74241]:         <nova:user uuid="a5402b24624c44ae88239677c5778850">tempest-AttachVolumeShelveTestJSON-882980696-project-member</nova:user>
Oct 20 12:22:37 user nova-compute[74241]:         <nova:project uuid="f3600c43897b483fb6ed35091763bc01">tempest-AttachVolumeShelveTestJSON-882980696</nova:project>
Oct 20 12:22:37 user nova-compute[74241]:       </nova:owner>
Oct 20 12:22:37 user nova-compute[74241]:       <nova:root type="image" uuid="9251735c-4454-4678-a835-c482dd85352d"/>
Oct 20 12:22:37 user nova-compute[74241]:       <nova:ports>
Oct 20 12:22:37 user nova-compute[74241]:         <nova:port uuid="36923475-e160-4b6c-9695-f2a7d4db09fc">
Oct 20 12:22:37 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 12:22:37 user nova-compute[74241]:         </nova:port>
Oct 20 12:22:37 user nova-compute[74241]:       </nova:ports>
Oct 20 12:22:37 user nova-compute[74241]:     </nova:instance>
Oct 20 12:22:37 user nova-compute[74241]:   </metadata>
Oct 20 12:22:37 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:22:37 user nova-compute[74241]:     <system>
Oct 20 12:22:37 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:22:37 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:22:37 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:22:37 user nova-compute[74241]:       <entry name="serial">4f9bc082-5a0c-4d38-a525-c83d4f42df31</entry>
Oct 20 12:22:37 user nova-compute[74241]:       <entry name="uuid">4f9bc082-5a0c-4d38-a525-c83d4f42df31</entry>
Oct 20 12:22:37 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:22:37 user nova-compute[74241]:     </system>
Oct 20 12:22:37 user nova-compute[74241]:   </sysinfo>
Oct 20 12:22:37 user nova-compute[74241]:   <os>
Oct 20 12:22:37 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:22:37 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:22:37 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:22:37 user nova-compute[74241]:   </os>
Oct 20 12:22:37 user nova-compute[74241]:   <features>
Oct 20 12:22:37 user nova-compute[74241]:     <acpi/>
Oct 20 12:22:37 user nova-compute[74241]:     <apic/>
Oct 20 12:22:37 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:22:37 user nova-compute[74241]:   </features>
Oct 20 12:22:37 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:22:37 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:22:37 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:22:37 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:22:37 user nova-compute[74241]:   </clock>
Oct 20 12:22:37 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:22:37 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:22:37 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:22:37 user nova-compute[74241]:   </cpu>
Oct 20 12:22:37 user nova-compute[74241]:   <devices>
Oct 20 12:22:37 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:22:37 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:22:37 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk"/>
Oct 20 12:22:37 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:22:37 user nova-compute[74241]:     </disk>
Oct 20 12:22:37 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:22:37 user nova-compute[74241]:       <mac address="fa:16:3e:2f:b9:93"/>
Oct 20 12:22:37 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:22:37 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:22:37 user nova-compute[74241]:       <target dev="tap36923475-e1"/>
Oct 20 12:22:37 user nova-compute[74241]:     </interface>
Oct 20 12:22:37 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:22:37 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/console.log" append="off"/>
Oct 20 12:22:37 user nova-compute[74241]:     </serial>
Oct 20 12:22:37 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:22:37 user nova-compute[74241]:     <video>
Oct 20 12:22:37 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:22:37 user nova-compute[74241]:     </video>
Oct 20 12:22:37 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:22:37 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:22:37 user nova-compute[74241]:     </rng>
Oct 20 12:22:37 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:22:37 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:22:37 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:22:37 user nova-compute[74241]:     </memballoon>
Oct 20 12:22:37 user nova-compute[74241]:   </devices>
Oct 20 12:22:37 user nova-compute[74241]: </domain>
Oct 20 12:22:37 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2031761672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2031761672',id=51,image_ref='9251735c-4454-4678-a835-c482dd85352d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-423527967',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:18:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ttzoeyt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member',shelved_at='2023-10-20T12:20:42.749021',shelved_host='user',shelved_image_id='9251735c-4454-4678-a835-c482dd85352d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:22:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=4f9bc082-5a0c-4d38-a525-c83d4f42df31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG os_vif [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1b1de92-b31b-59cd-8fed-180640a3729f', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36923475-e1, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36923475-e1, col_values=(('qos', UUID('6fc62d59-5510-4aa7-ba09-2d596bc5df8b')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36923475-e1, col_values=(('external_ids', {'iface-id': '36923475-e160-4b6c-9695-f2a7d4db09fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:b9:93', 'vm-uuid': '4f9bc082-5a0c-4d38-a525-c83d4f42df31'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:22:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:38 user nova-compute[74241]: INFO os_vif [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1')
Oct 20 12:22:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:22:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] No VIF found with MAC fa:16:3e:2f:b9:93, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:22:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-6b82b9bc-24e7-426f-ba53-975fca60247c req-5ad5f7ca-121b-4e4e-9f0f-1bbed0d21b93 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6b82b9bc-24e7-426f-ba53-975fca60247c req-5ad5f7ca-121b-4e4e-9f0f-1bbed0d21b93 service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6b82b9bc-24e7-426f-ba53-975fca60247c req-5ad5f7ca-121b-4e4e-9f0f-1bbed0d21b93 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-6b82b9bc-24e7-426f-ba53-975fca60247c req-5ad5f7ca-121b-4e4e-9f0f-1bbed0d21b93 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG nova.compute.manager [req-6b82b9bc-24e7-426f-ba53-975fca60247c req-5ad5f7ca-121b-4e4e-9f0f-1bbed0d21b93 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:22:39 user nova-compute[74241]: WARNING nova.compute.manager [req-6b82b9bc-24e7-426f-ba53-975fca60247c req-5ad5f7ca-121b-4e4e-9f0f-1bbed0d21b93 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 12:22:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:39 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:22:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:22:41 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance spawned successfully.
Oct 20 12:22:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-44eb57b9-c698-4947-9226-1eae6d3146e7 req-9582226d-6b73-4adb-9fdc-f3a743ae3376 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:22:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-44eb57b9-c698-4947-9226-1eae6d3146e7 req-9582226d-6b73-4adb-9fdc-f3a743ae3376 service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:22:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-44eb57b9-c698-4947-9226-1eae6d3146e7 req-9582226d-6b73-4adb-9fdc-f3a743ae3376 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:22:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-44eb57b9-c698-4947-9226-1eae6d3146e7 req-9582226d-6b73-4adb-9fdc-f3a743ae3376 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:41 user nova-compute[74241]: DEBUG nova.compute.manager [req-44eb57b9-c698-4947-9226-1eae6d3146e7 req-9582226d-6b73-4adb-9fdc-f3a743ae3376 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:22:41 user nova-compute[74241]: WARNING nova.compute.manager [req-44eb57b9-c698-4947-9226-1eae6d3146e7 req-9582226d-6b73-4adb-9fdc-f3a743ae3376 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 12:22:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:22:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-2939eb64-7c1c-491c-b26b-178b76fae987 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.915s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:22:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:22:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:22:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:22:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:23:25 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:31 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:23:33 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:23:34 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:23:34 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:23:34 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9056MB free_disk=25.084041595458984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance 4f9bc082-5a0c-4d38-a525-c83d4f42df31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:23:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:23:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:23:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:23:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:23:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:23:35 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:23:35 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:23:36 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [{"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:23:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-4f9bc082-5a0c-4d38-a525-c83d4f42df31" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:23:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:23:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:23:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:23:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:23:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:23:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:23:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:23:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:23:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:23:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:23:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:24:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:24:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:24:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:22 user nova-compute[74241]: INFO nova.compute.manager [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Terminating instance
Oct 20 12:24:22 user nova-compute[74241]: DEBUG nova.compute.manager [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-f1cbf71d-6cf2-4072-adcc-67603ab0e11a req-e714d4b0-c697-42e6-8d8f-ef44e924c70a service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f1cbf71d-6cf2-4072-adcc-67603ab0e11a req-e714d4b0-c697-42e6-8d8f-ef44e924c70a service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f1cbf71d-6cf2-4072-adcc-67603ab0e11a req-e714d4b0-c697-42e6-8d8f-ef44e924c70a service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f1cbf71d-6cf2-4072-adcc-67603ab0e11a req-e714d4b0-c697-42e6-8d8f-ef44e924c70a service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-f1cbf71d-6cf2-4072-adcc-67603ab0e11a req-e714d4b0-c697-42e6-8d8f-ef44e924c70a service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG nova.compute.manager [req-f1cbf71d-6cf2-4072-adcc-67603ab0e11a req-e714d4b0-c697-42e6-8d8f-ef44e924c70a service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Instance destroyed successfully.
Oct 20 12:24:22 user nova-compute[74241]: DEBUG nova.objects.instance [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lazy-loading 'resources' on Instance uuid 4f9bc082-5a0c-4d38-a525-c83d4f42df31 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T12:18:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2031761672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2031761672',id=51,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQo+mmCIHcBMBUgc2CLCnwjkDbgDJyAaWgAnK+u47TycTX9rpIkf2WcDuq4UXHnr6T/QXbhRsB8UsPW0O43cgq+HzeH3NLLSfElBPEy98I974Ye9xtviMSFK8uzeG9ybA==',key_name='tempest-keypair-423527967',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3600c43897b483fb6ed35091763bc01',ramdisk_id='',reservation_id='r-ttzoeyt8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-882980696',owner_user_name='tempest-AttachVolumeShelveTestJSON-882980696-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:22:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a5402b24624c44ae88239677c5778850',uuid=4f9bc082-5a0c-4d38-a525-c83d4f42df31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converting VIF {"id": "36923475-e160-4b6c-9695-f2a7d4db09fc", "address": "fa:16:3e:2f:b9:93", "network": {"id": "e1d1a769-de30-4418-9138-ef121ec74c51", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1996663574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3600c43897b483fb6ed35091763bc01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36923475-e1", "ovs_interfaceid": "36923475-e160-4b6c-9695-f2a7d4db09fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG os_vif [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36923475-e1, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fc62d59-5510-4aa7-ba09-2d596bc5df8b) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:22 user nova-compute[74241]: INFO os_vif [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:b9:93,bridge_name='br-int',has_traffic_filtering=True,id=36923475-e160-4b6c-9695-f2a7d4db09fc,network=Network(e1d1a769-de30-4418-9138-ef121ec74c51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36923475-e1')
Oct 20 12:24:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Deleting instance files /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31_del
Oct 20 12:24:22 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Deletion of /opt/stack/data/nova/instances/4f9bc082-5a0c-4d38-a525-c83d4f42df31_del complete
Oct 20 12:24:23 user nova-compute[74241]: INFO nova.compute.manager [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 20 12:24:23 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:24:23 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Took 0.89 seconds to deallocate network for instance.
Oct 20 12:24:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-46fa87b7-ca96-4cf7-ba45-b1b3ff123789 req-86ce972e-16d0-4dc8-838e-a8e21049c3c4 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-deleted-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:24:23 user nova-compute[74241]: INFO nova.compute.manager [req-46fa87b7-ca96-4cf7-ba45-b1b3ff123789 req-86ce972e-16d0-4dc8-838e-a8e21049c3c4 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Neutron deleted interface 36923475-e160-4b6c-9695-f2a7d4db09fc; detaching it from the instance and deleting it from the info cache
Oct 20 12:24:23 user nova-compute[74241]: DEBUG nova.network.neutron [req-46fa87b7-ca96-4cf7-ba45-b1b3ff123789 req-86ce972e-16d0-4dc8-838e-a8e21049c3c4 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:24:23 user nova-compute[74241]: DEBUG nova.compute.manager [req-46fa87b7-ca96-4cf7-ba45-b1b3ff123789 req-86ce972e-16d0-4dc8-838e-a8e21049c3c4 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Detach interface failed, port_id=36923475-e160-4b6c-9695-f2a7d4db09fc, reason: Instance 4f9bc082-5a0c-4d38-a525-c83d4f42df31 could not be found. {{(pid=74241) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:24 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Deleted allocations for instance 4f9bc082-5a0c-4d38-a525-c83d4f42df31
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-223bc95e-5a24-4024-8c99-e6d3646af4c7 tempest-AttachVolumeShelveTestJSON-882980696 tempest-AttachVolumeShelveTestJSON-882980696-project-member] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.938s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:24:24 user nova-compute[74241]: WARNING nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state deleted and task_state None.
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:24:24 user nova-compute[74241]: WARNING nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state deleted and task_state None.
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:24:24 user nova-compute[74241]: WARNING nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state deleted and task_state None.
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:24:24 user nova-compute[74241]: WARNING nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-unplugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state deleted and task_state None.
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Acquiring lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] Lock "4f9bc082-5a0c-4d38-a525-c83d4f42df31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:24 user nova-compute[74241]: DEBUG nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] No waiting events found dispatching network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:24:24 user nova-compute[74241]: WARNING nova.compute.manager [req-cb6950f0-03a8-417b-9323-69ef0d2cb4ff req-0545f5aa-064f-4e1d-b622-dba155918616 service nova] [instance: 4f9bc082-5a0c-4d38-a525-c83d4f42df31] Received unexpected event network-vif-plugged-36923475-e160-4b6c-9695-f2a7d4db09fc for instance with vm_state deleted and task_state None.
Oct 20 12:24:25 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:32 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:33 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:34 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:34 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:35 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:24:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:24:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:24:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=25.11130142211914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:24:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:24:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:24:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:24:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:24:36 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:24:36 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:24:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:24:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:24:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:24:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:24:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:24:37 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:40 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:42 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:47 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:51 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 12:24:51 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 12:24:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:24:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:24:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:24:52 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:24:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:24:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:24:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:24:57 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:24:59 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:24:59 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 12:25:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:25:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:25:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:25:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:25:02 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:07 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:25:11 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:25:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:25:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:25:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:25:12 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:17 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:25:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:25:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:25:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:25:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:25:22 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:25:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:25:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:25:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:25:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:34 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:25:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:25:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:25:35 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:25:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:25:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9158MB free_disk=25.11029052734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:25:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:25:37 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:25:37 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:25:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:25:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 12:25:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:25:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:25:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:26:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:26:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:26:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:26:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:26:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:26:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:26:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:26:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:26:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:27 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:30 user nova-compute[74241]: DEBUG nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Starting instance... {{(pid=74241) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 12:26:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:30 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:30 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74241) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 12:26:30 user nova-compute[74241]: INFO nova.compute.claims [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Claim successful on node user
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Start building networks asynchronously for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Allocating IP information in the background. {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.network.neutron [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] allocate_for_instance() {{(pid=74241) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 12:26:31 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Start building block device mappings for instance. {{(pid=74241) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.policy [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38d71db09bd34952a765a28a185b8667', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b50cb7d544dd423f98fe001812049bd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74241) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Start spawning the instance on the hypervisor. {{(pid=74241) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Creating instance directory {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 12:26:31 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Creating image(s)
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "/opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "/opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.196s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "27213cb42d3420a49f9359954e8f904dea393555" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.213s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk 1073741824 {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555,backing_fmt=raw /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk 1073741824" returned: 0 in 0.055s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "27213cb42d3420a49f9359954e8f904dea393555" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.network.neutron [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Successfully created port: 7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27213cb42d3420a49f9359954e8f904dea393555 --force-share --output=json" returned: 0 in 0.183s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk. size=1073741824 {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 12:26:31 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.virt.disk.api [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Cannot resize image /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk to a smaller size. {{(pid=74241) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Created local disks {{(pid=74241) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Ensure instance console log exists: /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/console.log {{(pid=74241) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Successfully updated port: 7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquired lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Building network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-9d0c3698-2245-4096-aaf9-a601a45481ab req-920fc549-6dd2-49a3-b6ed-fd51a7a0d3c2 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-changed-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.compute.manager [req-9d0c3698-2245-4096-aaf9-a601a45481ab req-920fc549-6dd2-49a3-b6ed-fd51a7a0d3c2 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Refreshing instance network info cache due to event network-changed-7d7cae46-41a4-480d-bf46-d5cda78f235c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9d0c3698-2245-4096-aaf9-a601a45481ab req-920fc549-6dd2-49a3-b6ed-fd51a7a0d3c2 service nova] Acquiring lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Instance cache missing network info. {{(pid=74241) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.network.neutron [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Releasing lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Instance network_info: |[{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74241) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9d0c3698-2245-4096-aaf9-a601a45481ab req-920fc549-6dd2-49a3-b6ed-fd51a7a0d3c2 service nova] Acquired lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.network.neutron [req-9d0c3698-2245-4096-aaf9-a601a45481ab req-920fc549-6dd2-49a3-b6ed-fd51a7a0d3c2 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Refreshing network info cache for port 7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:26:32 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Start _get_guest_xml network_info=[{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'device_name': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'encryption_options': None, 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'encryption_secret_uuid': None, 'image_id': 'f9a80c7e-66e2-4915-96f8-63e828cf6c2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 12:26:32 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:26:32 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] CPU controller missing on host. {{(pid=74241) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.host [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] CPU controller found on host. {{(pid=74241) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74241) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T11:28:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T11:29:10Z,direct_url=<?>,disk_format='qcow2',id=f9a80c7e-66e2-4915-96f8-63e828cf6c2e,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='0d78ec999c304667aab045a629f8a22b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T11:29:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Flavor limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Image limits 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Flavor pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Image pref 0:0:0 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74241) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Got 1 possible topologies {{(pid=74241) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.hardware [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74241) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1309793849',display_name='tempest-TestServerVolumeAttachmentScenario-server-1309793849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1309793849',id=52,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5BgqlaLKythMUkxM/C1+wsmhh/Sh8CzOhaiUY0XTPAUN0oZmdAmdGXrG4/DRmhrCVz0FWNnpVeQWhov0aedOXAbwUYg5+sW/kcZ8LEkk8CGgQ2cSNM3JbDZBgdJQCJRg==',key_name='tempest-keypair-1237033066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b50cb7d544dd423f98fe001812049bd4',ramdisk_id='',reservation_id='r-vdyw8z4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1571614553',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1571614553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d71db09bd34952a765a28a185b8667',uuid=f9e6c5ab-5374-4990-adc7-099b387bebd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74241) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Converting VIF {"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=7d7cae46-41a4-480d-bf46-d5cda78f235c,network=Network(681049e5-0d1f-412d-b588-ce458b4492c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7cae46-41') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.objects.instance [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lazy-loading 'pci_devices' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] End _get_guest_xml xml=<domain type="kvm">
Oct 20 12:26:33 user nova-compute[74241]:   <uuid>f9e6c5ab-5374-4990-adc7-099b387bebd7</uuid>
Oct 20 12:26:33 user nova-compute[74241]:   <name>instance-00000034</name>
Oct 20 12:26:33 user nova-compute[74241]:   <memory>524288</memory>
Oct 20 12:26:33 user nova-compute[74241]:   <vcpu>1</vcpu>
Oct 20 12:26:33 user nova-compute[74241]:   <metadata>
Oct 20 12:26:33 user nova-compute[74241]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 12:26:33 user nova-compute[74241]:       <nova:package version="0.0.0"/>
Oct 20 12:26:33 user nova-compute[74241]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1309793849</nova:name>
Oct 20 12:26:33 user nova-compute[74241]:       <nova:creationTime>2023-10-20 12:26:32</nova:creationTime>
Oct 20 12:26:33 user nova-compute[74241]:       <nova:flavor name="m1.tiny">
Oct 20 12:26:33 user nova-compute[74241]:         <nova:memory>512</nova:memory>
Oct 20 12:26:33 user nova-compute[74241]:         <nova:disk>1</nova:disk>
Oct 20 12:26:33 user nova-compute[74241]:         <nova:swap>0</nova:swap>
Oct 20 12:26:33 user nova-compute[74241]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 12:26:33 user nova-compute[74241]:         <nova:vcpus>1</nova:vcpus>
Oct 20 12:26:33 user nova-compute[74241]:       </nova:flavor>
Oct 20 12:26:33 user nova-compute[74241]:       <nova:owner>
Oct 20 12:26:33 user nova-compute[74241]:         <nova:user uuid="38d71db09bd34952a765a28a185b8667">tempest-TestServerVolumeAttachmentScenario-1571614553-project-member</nova:user>
Oct 20 12:26:33 user nova-compute[74241]:         <nova:project uuid="b50cb7d544dd423f98fe001812049bd4">tempest-TestServerVolumeAttachmentScenario-1571614553</nova:project>
Oct 20 12:26:33 user nova-compute[74241]:       </nova:owner>
Oct 20 12:26:33 user nova-compute[74241]:       <nova:root type="image" uuid="f9a80c7e-66e2-4915-96f8-63e828cf6c2e"/>
Oct 20 12:26:33 user nova-compute[74241]:       <nova:ports>
Oct 20 12:26:33 user nova-compute[74241]:         <nova:port uuid="7d7cae46-41a4-480d-bf46-d5cda78f235c">
Oct 20 12:26:33 user nova-compute[74241]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 12:26:33 user nova-compute[74241]:         </nova:port>
Oct 20 12:26:33 user nova-compute[74241]:       </nova:ports>
Oct 20 12:26:33 user nova-compute[74241]:     </nova:instance>
Oct 20 12:26:33 user nova-compute[74241]:   </metadata>
Oct 20 12:26:33 user nova-compute[74241]:   <sysinfo type="smbios">
Oct 20 12:26:33 user nova-compute[74241]:     <system>
Oct 20 12:26:33 user nova-compute[74241]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 12:26:33 user nova-compute[74241]:       <entry name="product">OpenStack Nova</entry>
Oct 20 12:26:33 user nova-compute[74241]:       <entry name="version">0.0.0</entry>
Oct 20 12:26:33 user nova-compute[74241]:       <entry name="serial">f9e6c5ab-5374-4990-adc7-099b387bebd7</entry>
Oct 20 12:26:33 user nova-compute[74241]:       <entry name="uuid">f9e6c5ab-5374-4990-adc7-099b387bebd7</entry>
Oct 20 12:26:33 user nova-compute[74241]:       <entry name="family">Virtual Machine</entry>
Oct 20 12:26:33 user nova-compute[74241]:     </system>
Oct 20 12:26:33 user nova-compute[74241]:   </sysinfo>
Oct 20 12:26:33 user nova-compute[74241]:   <os>
Oct 20 12:26:33 user nova-compute[74241]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 12:26:33 user nova-compute[74241]:     <boot dev="hd"/>
Oct 20 12:26:33 user nova-compute[74241]:     <smbios mode="sysinfo"/>
Oct 20 12:26:33 user nova-compute[74241]:   </os>
Oct 20 12:26:33 user nova-compute[74241]:   <features>
Oct 20 12:26:33 user nova-compute[74241]:     <acpi/>
Oct 20 12:26:33 user nova-compute[74241]:     <apic/>
Oct 20 12:26:33 user nova-compute[74241]:     <vmcoreinfo/>
Oct 20 12:26:33 user nova-compute[74241]:   </features>
Oct 20 12:26:33 user nova-compute[74241]:   <clock offset="utc">
Oct 20 12:26:33 user nova-compute[74241]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 12:26:33 user nova-compute[74241]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 12:26:33 user nova-compute[74241]:     <timer name="hpet" present="no"/>
Oct 20 12:26:33 user nova-compute[74241]:   </clock>
Oct 20 12:26:33 user nova-compute[74241]:   <cpu mode="custom" match="exact">
Oct 20 12:26:33 user nova-compute[74241]:     <model>Nehalem</model>
Oct 20 12:26:33 user nova-compute[74241]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 12:26:33 user nova-compute[74241]:   </cpu>
Oct 20 12:26:33 user nova-compute[74241]:   <devices>
Oct 20 12:26:33 user nova-compute[74241]:     <disk type="file" device="disk">
Oct 20 12:26:33 user nova-compute[74241]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 12:26:33 user nova-compute[74241]:       <source file="/opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk"/>
Oct 20 12:26:33 user nova-compute[74241]:       <target dev="vda" bus="virtio"/>
Oct 20 12:26:33 user nova-compute[74241]:     </disk>
Oct 20 12:26:33 user nova-compute[74241]:     <interface type="ethernet">
Oct 20 12:26:33 user nova-compute[74241]:       <mac address="fa:16:3e:50:60:a3"/>
Oct 20 12:26:33 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:26:33 user nova-compute[74241]:       <mtu size="1442"/>
Oct 20 12:26:33 user nova-compute[74241]:       <target dev="tap7d7cae46-41"/>
Oct 20 12:26:33 user nova-compute[74241]:     </interface>
Oct 20 12:26:33 user nova-compute[74241]:     <serial type="pty">
Oct 20 12:26:33 user nova-compute[74241]:       <log file="/opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/console.log" append="off"/>
Oct 20 12:26:33 user nova-compute[74241]:     </serial>
Oct 20 12:26:33 user nova-compute[74241]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 12:26:33 user nova-compute[74241]:     <video>
Oct 20 12:26:33 user nova-compute[74241]:       <model type="virtio"/>
Oct 20 12:26:33 user nova-compute[74241]:     </video>
Oct 20 12:26:33 user nova-compute[74241]:     <rng model="virtio">
Oct 20 12:26:33 user nova-compute[74241]:       <backend model="random">/dev/urandom</backend>
Oct 20 12:26:33 user nova-compute[74241]:     </rng>
Oct 20 12:26:33 user nova-compute[74241]:     <controller type="usb" index="0" model="none"/>
Oct 20 12:26:33 user nova-compute[74241]:     <memballoon model="virtio">
Oct 20 12:26:33 user nova-compute[74241]:       <stats period="10"/>
Oct 20 12:26:33 user nova-compute[74241]:     </memballoon>
Oct 20 12:26:33 user nova-compute[74241]:   </devices>
Oct 20 12:26:33 user nova-compute[74241]: </domain>
Oct 20 12:26:33 user nova-compute[74241]:  {{(pid=74241) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1309793849',display_name='tempest-TestServerVolumeAttachmentScenario-server-1309793849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1309793849',id=52,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5BgqlaLKythMUkxM/C1+wsmhh/Sh8CzOhaiUY0XTPAUN0oZmdAmdGXrG4/DRmhrCVz0FWNnpVeQWhov0aedOXAbwUYg5+sW/kcZ8LEkk8CGgQ2cSNM3JbDZBgdJQCJRg==',key_name='tempest-keypair-1237033066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b50cb7d544dd423f98fe001812049bd4',ramdisk_id='',reservation_id='r-vdyw8z4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1571614553',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1571614553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T12:26:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d71db09bd34952a765a28a185b8667',uuid=f9e6c5ab-5374-4990-adc7-099b387bebd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Converting VIF {"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=7d7cae46-41a4-480d-bf46-d5cda78f235c,network=Network(681049e5-0d1f-412d-b588-ce458b4492c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7cae46-41') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG os_vif [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=7d7cae46-41a4-480d-bf46-d5cda78f235c,network=Network(681049e5-0d1f-412d-b588-ce458b4492c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7cae46-41') {{(pid=74241) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8abc5285-66a1-5581-8f54-dfb49ca94041', '_type': 'linux-noop'}}, row=False) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d7cae46-41, may_exist=True, interface_attrs={}) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d7cae46-41, col_values=(('qos', UUID('5d4161d2-8629-453f-9fde-2510363b7232')),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d7cae46-41, col_values=(('external_ids', {'iface-id': '7d7cae46-41a4-480d-bf46-d5cda78f235c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:60:a3', 'vm-uuid': 'f9e6c5ab-5374-4990-adc7-099b387bebd7'}),), if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:33 user nova-compute[74241]: INFO os_vif [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=7d7cae46-41a4-480d-bf46-d5cda78f235c,network=Network(681049e5-0d1f-412d-b588-ce458b4492c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7cae46-41')
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No VIF found with MAC fa:16:3e:50:60:a3, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-9d0c3698-2245-4096-aaf9-a601a45481ab req-920fc549-6dd2-49a3-b6ed-fd51a7a0d3c2 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updated VIF entry in instance network info cache for port 7d7cae46-41a4-480d-bf46-d5cda78f235c. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG nova.network.neutron [req-9d0c3698-2245-4096-aaf9-a601a45481ab req-920fc549-6dd2-49a3-b6ed-fd51a7a0d3c2 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-9d0c3698-2245-4096-aaf9-a601a45481ab req-920fc549-6dd2-49a3-b6ed-fd51a7a0d3c2 service nova] Releasing lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:26:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-2f981a36-09ab-4a49-b0b1-1463eb1d58a8 req-da9324a6-7374-41d8-a953-31253188cb27 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:26:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2f981a36-09ab-4a49-b0b1-1463eb1d58a8 req-da9324a6-7374-41d8-a953-31253188cb27 service nova] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2f981a36-09ab-4a49-b0b1-1463eb1d58a8 req-da9324a6-7374-41d8-a953-31253188cb27 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:34 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-2f981a36-09ab-4a49-b0b1-1463eb1d58a8 req-da9324a6-7374-41d8-a953-31253188cb27 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:34 user nova-compute[74241]: DEBUG nova.compute.manager [req-2f981a36-09ab-4a49-b0b1-1463eb1d58a8 req-da9324a6-7374-41d8-a953-31253188cb27 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] No waiting events found dispatching network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:26:34 user nova-compute[74241]: WARNING nova.compute.manager [req-2f981a36-09ab-4a49-b0b1-1463eb1d58a8 req-da9324a6-7374-41d8-a953-31253188cb27 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received unexpected event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c for instance with vm_state building and task_state spawning.
Oct 20 12:26:34 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:26:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-bff2cd36-00f9-4bc9-afad-8313aca75f83 req-60ca6817-50ce-448d-93f6-f09aa664c099 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bff2cd36-00f9-4bc9-afad-8313aca75f83 req-60ca6817-50ce-448d-93f6-f09aa664c099 service nova] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bff2cd36-00f9-4bc9-afad-8313aca75f83 req-60ca6817-50ce-448d-93f6-f09aa664c099 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-bff2cd36-00f9-4bc9-afad-8313aca75f83 req-60ca6817-50ce-448d-93f6-f09aa664c099 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.compute.manager [req-bff2cd36-00f9-4bc9-afad-8313aca75f83 req-60ca6817-50ce-448d-93f6-f09aa664c099 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] No waiting events found dispatching network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:26:36 user nova-compute[74241]: WARNING nova.compute.manager [req-bff2cd36-00f9-4bc9-afad-8313aca75f83 req-60ca6817-50ce-448d-93f6-f09aa664c099 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received unexpected event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c for instance with vm_state building and task_state spawning.
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Instance event wait completed in 0 seconds for  {{(pid=74241) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Guest created on hypervisor {{(pid=74241) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 12:26:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:26:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9083MB free_disk=25.098705291748047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:26:36 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Instance spawned successfully.
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Found default for hw_cdrom_bus of ide {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Found default for hw_disk_bus of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Found default for hw_input_bus of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Found default for hw_pointer_model of None {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Found default for hw_video_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Found default for hw_vif_model of virtio {{(pid=74241) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f9e6c5ab-5374-4990-adc7-099b387bebd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:26:36 user nova-compute[74241]: INFO nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 20 12:26:36 user nova-compute[74241]: DEBUG nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Checking state {{(pid=74241) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 12:26:37 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:26:37 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:26:37 user nova-compute[74241]: INFO nova.compute.manager [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Took 6.21 seconds to build instance.
Oct 20 12:26:37 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:26:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-836a211c-612b-488f-9de6-a7bd16425bd3 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.344s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:26:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:26:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:26:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:26:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:26:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:26:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:26:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:26 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:27:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:27:35 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:27:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:27:35 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:27:35 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:27:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:27:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:27:35 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:27:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:27:36 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:27:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.070064544677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f9e6c5ab-5374-4990-adc7-099b387bebd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:27:36 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:27:37 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:37 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:27:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:27:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:27:38 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:27:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:27:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:27:38 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:27:38 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:27:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:27:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:27:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:27:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:47 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:27:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:27:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:27:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:27:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:27:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:27:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:27:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:27:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:27:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:27:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:27:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:27:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:27:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:27:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:28:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:28:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:28:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:28:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:28:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:28:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:28:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:28:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-d3beb383-c76f-4948-b0df-2115237f05ca req-7f77c556-608c-407a-a640-625b2348c51f service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-changed-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:28:21 user nova-compute[74241]: DEBUG nova.compute.manager [req-d3beb383-c76f-4948-b0df-2115237f05ca req-7f77c556-608c-407a-a640-625b2348c51f service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Refreshing instance network info cache due to event network-changed-7d7cae46-41a4-480d-bf46-d5cda78f235c. {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 12:28:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d3beb383-c76f-4948-b0df-2115237f05ca req-7f77c556-608c-407a-a640-625b2348c51f service nova] Acquiring lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:28:21 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d3beb383-c76f-4948-b0df-2115237f05ca req-7f77c556-608c-407a-a640-625b2348c51f service nova] Acquired lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:28:21 user nova-compute[74241]: DEBUG nova.network.neutron [req-d3beb383-c76f-4948-b0df-2115237f05ca req-7f77c556-608c-407a-a640-625b2348c51f service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Refreshing network info cache for port 7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 12:28:22 user nova-compute[74241]: DEBUG nova.network.neutron [req-d3beb383-c76f-4948-b0df-2115237f05ca req-7f77c556-608c-407a-a640-625b2348c51f service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updated VIF entry in instance network info cache for port 7d7cae46-41a4-480d-bf46-d5cda78f235c. {{(pid=74241) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 12:28:22 user nova-compute[74241]: DEBUG nova.network.neutron [req-d3beb383-c76f-4948-b0df-2115237f05ca req-7f77c556-608c-407a-a640-625b2348c51f service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:28:22 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-d3beb383-c76f-4948-b0df-2115237f05ca req-7f77c556-608c-407a-a640-625b2348c51f service nova] Releasing lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG nova.objects.instance [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lazy-loading 'flavor' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:28:23 user nova-compute[74241]: INFO nova.compute.manager [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Attaching volume b7f6ef5f-4576-4912-98b1-76683f42de89 to /dev/vdb
Oct 20 12:28:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG os_brick.utils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc1bab7-0bc6-4165-9822-afb5e106cc76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cc5ca4-d3fe-4300-9a1d-4e85bd737afc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa362035-fd26-47f9-9ede-24529b1a05ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c37c810-7fcf-4172-b3ae-766f0fb8c740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:28:23 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:28:23 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcf035a-c21d-4aff-bb8d-a32d6309795a]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG os_brick.utils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:28:23 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating existing volume attachment record: 712c19a0-e84c-4cfa-ba76-4f6c1e950cdb {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:28:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:28 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:38 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:28:38 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:28:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9007MB free_disk=25.069217681884766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f9e6c5ab-5374-4990-adc7-099b387bebd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:28:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lytcSQEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:28:39 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:28:39 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:28:39 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[341dbee9-4ae4-4179-8502-9e35be6df583]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:28:39 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[db39e38b-6df1-4a0f-be76-352ee8c053f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89] added
Oct 20 12:28:39 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68f228c-fd7d-4e64-8e53-924f99e86f31]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[118642e1-2308-4569-8da0-f65e01c7c39b]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lytcSQEK {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lytcSQEK" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[031a6f7a-63fd-4230-9c4e-5a61a8ce1ea9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lytcSQEK'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f68f0fc-fde2-440e-9845-9261c95d8061]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3dd906-2d40-4335-a2b4-d0ab02e78916]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 12:28:39 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 12:28:39 user nova-compute[74241]:  {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:28:39 user nova-compute[74241]: WARNING os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 12:28:39 user nova-compute[74241]: 
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f198da74-189e-474b-8515-daffe9d977a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89, portal: 172.16.0.220,3260]
Oct 20 12:28:39 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89, portal: 172.16.0.220,3260] successful.
Oct 20 12:28:39 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec1209b-f8d8-4fbb-bf05-30be538f29cc]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfdfd71-1d18-4fc7-bf76-36b338e0a5db]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:28:39 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:28:39 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f6b06e-ff22-4aa1-b1ed-854e5e66f130]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lytcSQEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:28:39 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:28:40 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:28:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:28:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:28:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:28:40 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26565323462393933', 'path': '/dev/sdb'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:28:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565323462393933', 'path': '/dev/sdb'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:28:40 user nova-compute[74241]: DEBUG nova.objects.instance [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lazy-loading 'flavor' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:28:40 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 12:28:40 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:28:40 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:28:40 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:28:40 user nova-compute[74241]:   <serial>b7f6ef5f-4576-4912-98b1-76683f42de89</serial>
Oct 20 12:28:40 user nova-compute[74241]: </disk>
Oct 20 12:28:40 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 12:28:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:28:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:28:41 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No VIF found with MAC fa:16:3e:50:60:a3, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:28:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-e137bcba-54e6-4128-987c-e991c00f0309 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.978s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:28:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:28:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:28:43 user nova-compute[74241]: DEBUG nova.objects.instance [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lazy-loading 'flavor' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:28:43 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:28:44 user nova-compute[74241]: INFO nova.compute.manager [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Attaching volume ee9b1a8d-8a37-474c-9963-b1c56a2f8cca to /dev/vdc
Oct 20 12:28:44 user nova-compute[74241]: DEBUG os_brick.utils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b68ddf-4759-4fd0-b267-0183edaaf06e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:97a664fb1b38\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d91e5b3-547c-4884-a72c-d64585af8545]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189a338-e93e-4312-9d37-8399e50e65ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[711965e7-a677-4f04-a5ab-7c0fb276ff81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Running cmd (subprocess): nvme version {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] 'nvme version' failed. Not Retrying. {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.nvmeof [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] nvme not present on system {{(pid=74241) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 12:28:44 user nova-compute[74241]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 12:28:44 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[423beebd-ef66-498d-a931-445ce45d6e89]: (4, '') {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74241) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.lightos [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] LIGHTOS: no hostnqn found. {{(pid=74241) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG os_brick.utils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:97a664fb1b38', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:28:44 user nova-compute[74241]: DEBUG nova.virt.block_device [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating existing volume attachment record: 3cb4ef37-3e8c-4204-a1e8-67a662c20d9b {{(pid=74241) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 12:28:45 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:28:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:28:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Calling os-brick to attach iSCSI Volume {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPMYaTte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:28:59 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:28:59 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:28:59 user nova-compute[74241]: INFO os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c291ef-a235-4970-a56d-39c048760386]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 12:28:59 user nova-compute[74241]:  {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --interface default --op new {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0973735a-5c93-4903-9571-f3a3267e1040]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca] added\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca] added
Oct 20 12:28:59 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7417a5-e32e-40e3-a2a4-afcddfe1852f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e52290-d405-4531-959a-b74c40e78523]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPMYaTte {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPMYaTte" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f8073a-1c5b-4b15-84d1-b7e3b5388631]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPMYaTte'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:28:59 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[17056741-e31b-4508-855b-27d56ac8ccc6]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd301740-8b9a-4832-b10f-e8295adec091]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:29:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:29:00 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:29:00 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --login {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --login" returned: 0 in 1.057s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[de633278-36f4-41b2-a5dd-b2cf2af4cbd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca, portal: 172.16.0.220,3260]
Oct 20 12:29:01 user nova-compute[74241]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca, portal: 172.16.0.220,3260] successful.
Oct 20 12:29:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee6bfd-6854-42bd-b36e-638677ff03e9]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[085df328-fee3-46b7-b141-fefcb414dd30]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:29:01 user nova-compute[74241]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca (non-flash)
Oct 20 12:29:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:29:01 user nova-compute[74241]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca (non-flash)
Oct 20 12:29:01 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.288s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Connected to 172.16.0.220:3260 {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74241) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74241) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac47624b-85c8-4272-9506-952155a8300d]: (4, ('- - 0', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:01 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74241) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPMYaTte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74241) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.323s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] <== connect_volume: return (2325ms) {'type': 'block', 'scsi_wwn': '26431306636333836', 'path': '/dev/sdc'} {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431306636333836', 'path': '/dev/sdc'} {{(pid=74241) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG nova.objects.instance [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lazy-loading 'flavor' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 12:29:02 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:29:02 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:29:02 user nova-compute[74241]:   <target dev="vdc" bus="virtio"/>
Oct 20 12:29:02 user nova-compute[74241]:   <serial>ee9b1a8d-8a37-474c-9963-b1c56a2f8cca</serial>
Oct 20 12:29:02 user nova-compute[74241]: </disk>
Oct 20 12:29:02 user nova-compute[74241]:  {{(pid=74241) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No BDM found with device name vda, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74241) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] No VIF found with MAC fa:16:3e:50:60:a3, not building metadata {{(pid=74241) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 12:29:02 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-863c1ceb-bc6a-4505-b854-7b84270925c0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.619s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:29:03 user nova-compute[74241]: INFO nova.compute.manager [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Detaching volume ee9b1a8d-8a37-474c-9963-b1c56a2f8cca
Oct 20 12:29:03 user nova-compute[74241]: INFO nova.virt.block_device [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Attempting to driver detach volume ee9b1a8d-8a37-474c-9963-b1c56a2f8cca from mountpoint /dev/vdc
Oct 20 12:29:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Attempting to detach device vdc from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:29:03 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:29:03 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:29:03 user nova-compute[74241]:   <target dev="vdc" bus="virtio"/>
Oct 20 12:29:03 user nova-compute[74241]:   <serial>ee9b1a8d-8a37-474c-9963-b1c56a2f8cca</serial>
Oct 20 12:29:03 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 12:29:03 user nova-compute[74241]: </disk>
Oct 20 12:29:03 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:29:03 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Successfully detached device vdc from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 from the persistent domain config.
Oct 20 12:29:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:29:03 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:29:03 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:29:03 user nova-compute[74241]:   <source dev="/dev/sdc"/>
Oct 20 12:29:03 user nova-compute[74241]:   <target dev="vdc" bus="virtio"/>
Oct 20 12:29:03 user nova-compute[74241]:   <serial>ee9b1a8d-8a37-474c-9963-b1c56a2f8cca</serial>
Oct 20 12:29:03 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 12:29:03 user nova-compute[74241]: </disk>
Oct 20 12:29:03 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:29:04 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:29:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:29:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:24 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 is timed out.
Oct 20 12:29:24 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Successfully detached device vdc from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 from the live domain config.
Oct 20 12:29:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPMYaTte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:29:24 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71d5d38-cb1e-423b-9f0f-4dfdc03660e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:29:24 user nova-compute[74241]: No targets found.
Oct 20 12:29:24 user nova-compute[74241]: iSNS:
Oct 20 12:29:24 user nova-compute[74241]: No targets found.
Oct 20 12:29:24 user nova-compute[74241]: STATIC:
Oct 20 12:29:24 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca
Oct 20 12:29:24 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:29:24 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:29:24 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89
Oct 20 12:29:24 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:29:24 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:29:24 user nova-compute[74241]: FIRMWARE:
Oct 20 12:29:24 user nova-compute[74241]: No targets found.
Oct 20 12:29:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:29:24 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:29:24 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7239016-6dc5-4b4a-b1ad-f46fffe9a0b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[197eecda-cdad-4d0a-97ae-6dbe4a5c28f4]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:29:24 user nova-compute[74241]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca (non-flash)
Oct 20 12:29:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:29:24 user nova-compute[74241]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca (non-flash)
Oct 20 12:29:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52285f2dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca'): ({'sdc'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Removing single pathed devices sdc {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2125867-0e93-4715-a317-934ea5fb4644]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcc3771-e8fb-45a5-ad2f-9fdd928799ed]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Flushing IO for device /dev/sdc {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e005baf8-eb1c-40c1-a8f5-d0bb54541cbd]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4dafd4-9823-4829-ba26-b2d6e093295f]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] SCSI volumes sdc have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ebce4a-5246-45eb-b699-09da5eb6c0b4]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff44a9-ece6-472f-b9df-0346e7bcf4b9]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca, portal: 172.16.0.220,3260]
Oct 20 12:29:24 user nova-compute[74241]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca, portal: 172.16.0.220,3260] successful.
Oct 20 12:29:24 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee9b1a8d-8a37-474c-9963-b1c56a2f8cca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e54b115-c7b4-4a1b-b2cf-41b18bd0022f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] <== disconnect_volume: return (305ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:29:24 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:29:25 user nova-compute[74241]: DEBUG nova.objects.instance [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lazy-loading 'flavor' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:29:25 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-16937dee-0a70-4ad4-9ac9-17496fdea203 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.679s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:29:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:30 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:29:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:36 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:37 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:29:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:29:37 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:29:37 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:29:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:37 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74241) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:38 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:29:38 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:29:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.067859649658203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f9e6c5ab-5374-4990-adc7-099b387bebd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:29:38 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:29:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:29:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:29:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:29:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:29:39 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:29:39 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:29:40 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:29:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:29:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:29:40 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:40 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:29:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:29:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:46 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:47 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:29:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:48 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:29:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:53 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:29:54 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:29:54 user nova-compute[74241]: INFO nova.compute.manager [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Detaching volume b7f6ef5f-4576-4912-98b1-76683f42de89
Oct 20 12:29:54 user nova-compute[74241]: INFO nova.virt.block_device [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Attempting to driver detach volume b7f6ef5f-4576-4912-98b1-76683f42de89 from mountpoint /dev/vdb
Oct 20 12:29:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Attempting to detach device vdb from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 from the persistent domain config. {{(pid=74241) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 12:29:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:29:54 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:29:54 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:29:54 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:29:54 user nova-compute[74241]:   <serial>b7f6ef5f-4576-4912-98b1-76683f42de89</serial>
Oct 20 12:29:54 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:29:54 user nova-compute[74241]: </disk>
Oct 20 12:29:54 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:29:54 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Successfully detached device vdb from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 from the persistent domain config.
Oct 20 12:29:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 from the live domain config. {{(pid=74241) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 12:29:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.guest [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 12:29:54 user nova-compute[74241]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 12:29:54 user nova-compute[74241]:   <source dev="/dev/sdb"/>
Oct 20 12:29:54 user nova-compute[74241]:   <target dev="vdb" bus="virtio"/>
Oct 20 12:29:54 user nova-compute[74241]:   <serial>b7f6ef5f-4576-4912-98b1-76683f42de89</serial>
Oct 20 12:29:54 user nova-compute[74241]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 12:29:54 user nova-compute[74241]: </disk>
Oct 20 12:29:54 user nova-compute[74241]:  {{(pid=74241) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 12:29:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:29:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 12:29:54 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] There are 0 instances to clean {{(pid=74241) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 12:29:54 user nova-compute[74241]: DEBUG nova.virt.libvirt.driver [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 12:29:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:29:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:29:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:29:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:29:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:30:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:03 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:05 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:05 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74241) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 12:30:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:30:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:08 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:30:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:13 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:14 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 is timed out.
Oct 20 12:30:14 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Successfully detached device vdb from instance f9e6c5ab-5374-4990-adc7-099b387bebd7 from the live domain config.
Oct 20 12:30:14 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] calling os-brick to detach iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f522844c400>, {'target_iqn': 'iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lytcSQEK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 12:30:14 user nova-compute[74241]: WARNING os_brick.initiator.connectors.base [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2c6d8f-fb3c-40fe-92dc-1ee19248a709]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 12:30:14 user nova-compute[74241]: No targets found.
Oct 20 12:30:14 user nova-compute[74241]: iSNS:
Oct 20 12:30:14 user nova-compute[74241]: No targets found.
Oct 20 12:30:14 user nova-compute[74241]: STATIC:
Oct 20 12:30:14 user nova-compute[74241]: Target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89
Oct 20 12:30:14 user nova-compute[74241]:         Portal: 172.16.0.220:3260,-1
Oct 20 12:30:14 user nova-compute[74241]:                 Iface Name: default
Oct 20 12:30:14 user nova-compute[74241]: FIRMWARE:
Oct 20 12:30:14 user nova-compute[74241]: No targets found.
Oct 20 12:30:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 12:30:14 user nova-compute[74241]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 12:30:14 user nova-compute[74241]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74241) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89', 0)] {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25426ac-935e-4083-9cdb-b36ab181f3d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[373dac6f-b417-4f8c-b991-47651dd4e040]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:30:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 (non-flash)
Oct 20 12:30:14 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f52084cf5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89'): ({'sdb'}, set())}) {{(pid=74241) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Removing single pathed devices sdb {{(pid=74241) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b00ab2-0d69-4609-bf91-9623672e8f89]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca07bd-1dc8-405f-ab67-21e74a471008]: (4, ('ok\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Flushing IO for device /dev/sdb {{(pid=74241) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aa6633-e1c5-494d-b484-37d1ed73b822]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74241) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e045bb-df02-4ef8-905b-cb61cab5583d]: (4, ('1', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.linuxscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] SCSI volumes sdb have been removed. {{(pid=74241) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89')] {{(pid=74241) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded9a7a3-311b-4e25-8d0c-97cbfb990f0f]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:30:14 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --logout {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded68961-f177-4d50-8279-4a514ad6aabd]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89, portal: 172.16.0.220,3260]
Oct 20 12:30:15 user nova-compute[74241]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89, portal: 172.16.0.220,3260] successful.
Oct 20 12:30:15 user nova-compute[74241]:  stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op delete {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7f6ef5f-4576-4912-98b1-76683f42de89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85185) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceaed9a-de12-4315-ae50-e3abf8b80b81]: (4, ('', '')) {{(pid=85185) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74241) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.base [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG os_brick.initiator.connectors.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] <== disconnect_volume: return (322ms) None {{(pid=74241) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG nova.virt.libvirt.volume.iscsi [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Disconnected iSCSI Volume {{(pid=74241) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG nova.objects.instance [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lazy-loading 'flavor' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:30:15 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-93399ddc-e6bf-4a1e-ab7a-4e0301cb6ae0 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.763s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:18 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:20 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:23 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:25 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:28 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:30:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:33 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:38 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:39 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG oslo_concurrency.processutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 12:30:40 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:30:40 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.067218780517578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Instance f9e6c5ab-5374-4990-adc7-099b387bebd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74241) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing inventories for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating ProviderTree inventory for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Updating inventory in ProviderTree for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing aggregate associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, aggregates: None {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Refreshing trait associations for resource provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2, traits: COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING {{(pid=74241) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:30:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:41 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:30:41 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:30:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 12:30:41 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquired lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 12:30:41 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Forcefully refreshing network info cache for instance {{(pid=74241) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 12:30:41 user nova-compute[74241]: DEBUG nova.objects.instance [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lazy-loading 'info_cache' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:30:42 user nova-compute[74241]: DEBUG nova.network.neutron [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [{"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:30:42 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Releasing lock "refresh_cache-f9e6c5ab-5374-4990-adc7-099b387bebd7" {{(pid=74241) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 12:30:42 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updated the network info_cache for instance {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 12:30:42 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:30:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:43 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:44 user nova-compute[74241]: INFO nova.compute.manager [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Terminating instance
Oct 20 12:30:44 user nova-compute[74241]: DEBUG nova.compute.manager [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Start destroying the instance on the hypervisor. {{(pid=74241) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:44 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-f9af3337-ccf7-4104-82c4-aaa050afb99d req-d0bd44c4-dbfc-45cd-b58a-90dccd55ac2a service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-unplugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f9af3337-ccf7-4104-82c4-aaa050afb99d req-d0bd44c4-dbfc-45cd-b58a-90dccd55ac2a service nova] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f9af3337-ccf7-4104-82c4-aaa050afb99d req-d0bd44c4-dbfc-45cd-b58a-90dccd55ac2a service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-f9af3337-ccf7-4104-82c4-aaa050afb99d req-d0bd44c4-dbfc-45cd-b58a-90dccd55ac2a service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-f9af3337-ccf7-4104-82c4-aaa050afb99d req-d0bd44c4-dbfc-45cd-b58a-90dccd55ac2a service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] No waiting events found dispatching network-vif-unplugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.compute.manager [req-f9af3337-ccf7-4104-82c4-aaa050afb99d req-d0bd44c4-dbfc-45cd-b58a-90dccd55ac2a service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-unplugged-7d7cae46-41a4-480d-bf46-d5cda78f235c for instance with task_state deleting. {{(pid=74241) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: INFO nova.virt.libvirt.driver [-] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Instance destroyed successfully.
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.objects.instance [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lazy-loading 'resources' on Instance uuid f9e6c5ab-5374-4990-adc7-099b387bebd7 {{(pid=74241) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.virt.libvirt.vif [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T12:26:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1309793849',display_name='tempest-TestServerVolumeAttachmentScenario-server-1309793849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1309793849',id=52,image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5BgqlaLKythMUkxM/C1+wsmhh/Sh8CzOhaiUY0XTPAUN0oZmdAmdGXrG4/DRmhrCVz0FWNnpVeQWhov0aedOXAbwUYg5+sW/kcZ8LEkk8CGgQ2cSNM3JbDZBgdJQCJRg==',key_name='tempest-keypair-1237033066',keypairs=<?>,launch_index=0,launched_at=2023-10-20T12:26:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b50cb7d544dd423f98fe001812049bd4',ramdisk_id='',reservation_id='r-vdyw8z4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f9a80c7e-66e2-4915-96f8-63e828cf6c2e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1571614553',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1571614553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T12:26:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38d71db09bd34952a765a28a185b8667',uuid=f9e6c5ab-5374-4990-adc7-099b387bebd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Converting VIF {"id": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "address": "fa:16:3e:50:60:a3", "network": {"id": "681049e5-0d1f-412d-b588-ce458b4492c0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2068623930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b50cb7d544dd423f98fe001812049bd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d7cae46-41", "ovs_interfaceid": "7d7cae46-41a4-480d-bf46-d5cda78f235c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.network.os_vif_util [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=7d7cae46-41a4-480d-bf46-d5cda78f235c,network=Network(681049e5-0d1f-412d-b588-ce458b4492c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7cae46-41') {{(pid=74241) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG os_vif [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=7d7cae46-41a4-480d-bf46-d5cda78f235c,network=Network(681049e5-0d1f-412d-b588-ce458b4492c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7cae46-41') {{(pid=74241) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d7cae46-41, bridge=br-int, if_exists=True) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d4161d2-8629-453f-9fde-2510363b7232) {{(pid=74241) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:45 user nova-compute[74241]: INFO os_vif [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=7d7cae46-41a4-480d-bf46-d5cda78f235c,network=Network(681049e5-0d1f-412d-b588-ce458b4492c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d7cae46-41')
Oct 20 12:30:45 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Deleting instance files /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7_del
Oct 20 12:30:45 user nova-compute[74241]: INFO nova.virt.libvirt.driver [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Deletion of /opt/stack/data/nova/instances/f9e6c5ab-5374-4990-adc7-099b387bebd7_del complete
Oct 20 12:30:45 user nova-compute[74241]: INFO nova.compute.manager [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 12:30:45 user nova-compute[74241]: DEBUG oslo.service.loopingcall [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74241) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.compute.manager [-] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Deallocating network for instance {{(pid=74241) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] deallocate_for_instance() {{(pid=74241) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:46 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:46 user nova-compute[74241]: DEBUG nova.network.neutron [-] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Updating instance_info_cache with network_info: [] {{(pid=74241) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 12:30:46 user nova-compute[74241]: INFO nova.compute.manager [-] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Took 1.01 seconds to deallocate network for instance.
Oct 20 12:30:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:46 user nova-compute[74241]: DEBUG nova.compute.manager [req-7a1a14c7-b473-4b4a-a5cc-461d0abc54ee req-1d93eb50-9134-4c23-82a7-464e1dfd1f97 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-deleted-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:30:46 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:30:46 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:30:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:46 user nova-compute[74241]: INFO nova.scheduler.client.report [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Deleted allocations for instance f9e6c5ab-5374-4990-adc7-099b387bebd7
Oct 20 12:30:46 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-cac2b854-a63e-4dde-885f-4e31f10a4909 tempest-TestServerVolumeAttachmentScenario-1571614553 tempest-TestServerVolumeAttachmentScenario-1571614553-project-member] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] No waiting events found dispatching network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:30:47 user nova-compute[74241]: WARNING nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received unexpected event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c for instance with vm_state deleted and task_state None.
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] No waiting events found dispatching network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:30:47 user nova-compute[74241]: WARNING nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received unexpected event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c for instance with vm_state deleted and task_state None.
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] No waiting events found dispatching network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:30:47 user nova-compute[74241]: WARNING nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received unexpected event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c for instance with vm_state deleted and task_state None.
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-unplugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] No waiting events found dispatching network-vif-unplugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:30:47 user nova-compute[74241]: WARNING nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received unexpected event network-vif-unplugged-7d7cae46-41a4-480d-bf46-d5cda78f235c for instance with vm_state deleted and task_state None.
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Acquiring lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] Lock "f9e6c5ab-5374-4990-adc7-099b387bebd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:30:47 user nova-compute[74241]: DEBUG nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] No waiting events found dispatching network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c {{(pid=74241) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 12:30:47 user nova-compute[74241]: WARNING nova.compute.manager [req-17c68d74-32da-4bb6-841b-448dad665d31 req-970d114e-040c-46a0-88fb-5d931e0d56e5 service nova] [instance: f9e6c5ab-5374-4990-adc7-099b387bebd7] Received unexpected event network-vif-plugged-7d7cae46-41a4-480d-bf46-d5cda78f235c for instance with vm_state deleted and task_state None.
Oct 20 12:30:48 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:54 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:30:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:30:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:30:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:30:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:30:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:31:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:31:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:31:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:31:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:31:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:31:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:31:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:31:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:31:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:31:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:31:25 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:30 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:31:32 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:34 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:35 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:38 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:39 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74241) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 12:31:39 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:31:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:31:39 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:31:39 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Auditing locally available compute resources for user (node: user) {{(pid=74241) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 12:31:40 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:31:40 user nova-compute[74241]: WARNING nova.virt.libvirt.driver [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 12:31:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Hypervisor/Node resource view: name=user free_ram=9125MB free_disk=25.094242095947266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=74241) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74241) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG nova.compute.provider_tree [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed in ProviderTree for provider: 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 {{(pid=74241) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG nova.scheduler.client.report [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Inventory has not changed for provider 34e63c41-61c0-494b-ac17-d5bfda3fa5f2 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74241) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG nova.compute.resource_tracker [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Compute_service record updated for user:user {{(pid=74241) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG oslo_concurrency.lockutils [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=74241) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:31:40 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Starting heal instance info cache {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 12:31:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Rebuilding the list of instances to heal {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 12:31:43 user nova-compute[74241]: DEBUG nova.compute.manager [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Didn't find any instances for network info cache update. {{(pid=74241) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 12:31:43 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:44 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:45 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:50 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:50 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:52 user nova-compute[74241]: DEBUG oslo_service.periodic_task [None req-6ce91144-1d8f-40e2-82f2-9370016ade14 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74241) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 12:31:55 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:31:56 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:31:58 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:32:00 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:32:05 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:32:10 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:32:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 12:32:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:32:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74241) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 12:32:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:32:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74241) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 12:32:15 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 12:32:20 user nova-compute[74241]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74241) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}